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ABSTRACT 

This practlcum was designed to develop instruments 
and ^procedures for monitoring multiple educational programs* 
These instruments and procedures were used by staff to con- 
duct analyses of federal 9nd state regulations and program 
quality for each program^ as well as the connections among 
them« 

r 

Instruments and procedures were developed^ Staff ^ 
members were trained in the use of the techniques and a 
pilot review was performed in 17 programs and 7^ school 
sites. The practlcum was evaluated and a modified^ tested 
instrument and procedures were created. 

.The California State Department of Education is respon- 
sible^ by state and federal law, for the monitor and review 
of most categorical programs.. In the past, many different 
units we x»e assigned to monitor these programs. Serious 
problems often resulted. Esther ^the programs were not 
monitored, or numerous groups mi^t perform on-slt^vislts 
to the schools. -"''^^ 

This practlcum represents a successful effort to develop 
an integrated monitoring system which coordinated staff 
effort within the Department. For the first time, on-site 
visits were conducted in a manner that corresponded with 
the new consolidated application process. 

The objective of this practlcum was to devise a method 
that would provide the data necessary to make decisions 
concerning continued funding of individual consolidated 
progranis. Monitoring instruments and procedures were devel- 
oped to accomplish this objective. A system of monitoring 
and reviewing operational programs was developed so that 
staff could analyze multiple programs in operation at each 
school site. The system allowed relationships between 
programs to be observed in such a way that the Department 
could determine whether individual programs were being, 
implemented in accordance with the law and whether the 
funds were being used optimally in terms of the total 
activity at the site. 

Ey involving county office staff in a joint planning ^ 
effort and systematically following planned procedures^ 
the new system was created. Beyond the scope of this 
practlcum, the new monitor and review system will be 
Implemented In 71 districts and 4l4 school sites. 
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PART I: PURPOSE OP THE PRACTICUM 
A, Summary of Objective ^ , 

In 1969 the California State Department of Education 

V 

'began to. develop a consolidated application for. specially 
funded programs. In that year thirty school districts 
experimented with a consoll'dated application which r 
was used as a. basic application for. several programs. 
The effprt slowly began to demonstrate promise, Leter^ 
during the 1973-7^^ and 197^4-75 school years, nearly 
every ^hool district In California was Included In a 
consolidated application for special]^ funded programs. 

V ' ' ' ■ 

Cax^.x'ornla/ together with a small number of states . 
has attempted to study and test the possibility of 
developing a consolidated application which could be 
used to secure funding from varlous_sources and to 
Improve programs. Thus, a serious attempt was made to 
develop better systems than the separate ones which 
had been utilized. 

/. 

"I 

This practlcum was designed to Improve the existing 
consolidated programs and to ensure thai the laws were 
followed. Moreover, efforts In this practlcum also? 
attempted to ensure that the new system for developing 



programs did not allow programs for disadvantage<| 
children^ for whdra substantive parts of the funds 
Here directed, to be diluted • 

Olven the existence of a newly developed consoli- 
dated application, efforts In this practlcum were 
directed |o the development of a means of assessing 
operational programs as they were actually being Imple- 
mented. The consolidated application movement funded 
programs and placed them in^ operation. A system of 
monitoring and reviewing operational programs needed 
to be developed so that one could analyze the multiple 
programs in action at each school site* Then relation* 
ship^ between programs could be observed so that the 
California State Department of Education could determine 
whether individual /programs werJ being implemented in 
accordance with the law and whether funds were being 
used optimally in terms of the total activity at the ^ 
site* 

The objective of this practlcum has been designed 
to devise a method that will provide the >n'ecessary data 
to make decisions concerning continued funding of indi - 
vidua 1 consolidated programs > A monitoring instrument 
and a technique will be developed which will provide 
this data , ' ' 



Why was a consolidated application effort necessary 
In the first place? The answer to this question is 
provided by COGRAM - Consolidated Grants Management, 
which Is a Joint effort by the U.S. Office of Education 
and seven states: ' 

' "Many categorical education programs have 
been funded by the federal and state govern- 
' menta and by school districts. Sometimes, 
funds for these programs have been made avail* 
able from all three sources for the same 
activity. The result has been that duplication 
of effor* has occurred.. / 

"As a general rule, the administration 
of similar programs by separate offices 
according to funding source Is not conducive 
to good management of resources. Therefore, 
three questions arise: 

- Would a single consolidated, comprehen- 
sive application help bring about a more 
effective use of various funds? 

- Is a consolidated application feasible? 
-'How would a consolidated application be 

administered? "1 
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^COGRAM . Consolidated Grants Management . "Why:", 
July, 197^ 
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The California State Department of Education, as 
Indicated, had developed a consolidated grants management 
procedure as early as 1969* Six other states have also 
made various efforts at consolidation. However^ none • 
of the states had made any progress In developing a 
consolidated monitor and review system.^ There jias 
truly a need to develop -an Integrated monitoring system 
which would look at thpse programs separately and as 
a whole. This practlcum v:ould serve as a plopeer effort 
for state departments of education. 

In order for the prrcticum to develop a consolidated 
Monitor and Review system (KA^), It would be necessary 
to accomplish some rather definitive tasTcs, such as: 

1. Cabinet approval to design the Instrument and 
techniques. 

2. Recruitment of the planning team. 

3. An analysis of the lv?gal elements of each 
program. 

County office of education Involvement. 

5. Development of an Instrument for the Pilot MAR. 

6. Establishment of complete MAR procedures. 



Op. clt . M Progress reports of COGRAM participants^ 
June, 197^. 



7, Selection of State Department of Education 
staff for Pilot MAR. 

8, Recruitment of county office of education 
staff for the Pilot effort. 

9, Joint MAR Inservlce training, 

10, On-site MAR reviews. 

11, Submission of MAR reports to districts. 

12, Development of a modified MAR instrtiment. 

13, Secure staffafor 197^-75 MAR effort. , 

I ... - 

1 

• I 
I 

» j 

f 

/ ■ 
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B, Statement of Objective Completed . 

The primary pr^cticum objective vts completed In 
Au^u^t of 1974 when the State Board of Education • ^ 

endorsed the California State Department of Edwcatlon's 
system of ra6i!j.torlng and reviewing consolidated programs. 
The California State Department of Education has the 
very first system for reviewing programjs In a consolidated 
manner. Using a consolidated approach Wing t^e 
19^-74 school year, the Depar|;ment reviewed 17 programs 
in Jh school sites. During the 1974-75 school year, it ' 
is anticipated that the Department >iiil review .programs 
In 71 districts and 414 school sites. 

^--s^is consolidated approach to reviewing iprograms 
repre^ts a new educational change. 'This assumption 
appears to be substantiated by the fact that I conducted 
several searches In a survey of the literature. I 
activated a national ERIC search in order to compare 
similar approaches. There were no other efforts 
recorded In the system. I also utilized the Contra 
Costa County Office of Education's research system 
which Is available to the Fairfield Cluster. This 
professional research system also revealed no comparable 
efforts. ' ■ , 
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SJ.nce I generally prefe? to substantiate my hypo- 



theses and findings, I Initially viewed this situation 
88 8 major setback. Later, however. It became Increas- 
ingly apparent that an educational Innovation had 
occurred. 



Appendix A lllulstrates the programs that were 
actually reviev-ed during the spring semester of the 
1973-7^ school year. ^An examination will reveal the 
geographical dispersion. The siJ?e and. nature of 
districts wrre ?1 so quite divergent. If the schedule, 
for 197^-75 is followed, 71 districts will be reviewed, 
extending the effort to ^1^ school sites. 

All tasks have been completed,, and a complete 
description of the process Involved and the degree of 
success will be described In Pert II.B. which describes 



In accordance with the objective, the California 
State Department of Education now has a systematic 
monitor and ^view system that will provide the data 
necessary to make decisions concerning funding of 
Individual consolidated programs. 



the execution of the practlcum. 
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One of the tasks or obtaining county office Involve- 
ment became a^y-product that proved to be equally as 
^ significant as the objective itself • Just as. Michael, 
Scrlven posits, the by-products of an objective may be 
equally as important in a goal free evaluation. 
Indeed, this was true in the. practicum. ' \ 

The Califprnia State Department of Education and 
the 58 county offices, bs a direct result of 'the efforts 
in the practicum, are united in an unprecedented effort 
of Joint cooperation. During the 1973-7^ school year 
22 county office stgff members participated in the review 
of the consolidated school programs. During the 197^-75 
school year, 87 county staff members will have, partici- 
pated for a- total of IO9. The California Superintendent 
of Public Instruction has praised this new partnership 
• in major speecfies: * " ' / 

. . . "The cooperation that h&s been 
established between County offices and the . 
State Department of Education in setting up 
the Monitor and Review* component of our 
delivery system is the fulfillment of a long 
^cherished desire of mine. I will be frank 
to admit that I am not interested in expanding 
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the staff of the State Department of Education, 
iifeel, and I h9.ve always felt, that we should 
develop a partnership .with "^he County offices 
to provide the serv^^ces required by local 
districts, • • . 

"We have now established that paivtnershlp 
in^reallty. Each of your six regional groups 
has generously contrlbulfed staff td augment 
our Monitor ^nd Review Te$ms, You have 
worked with us to plan and develop all of • 
the monitor and review instruments. You 
are assisting with the in service training 
necessary to put this' effort into operation 
. , , I want to express my deep appreciation 
to Glen Hoffman and Nell Wade for the strong 
support they have given(^this effort and I 
would also like to thank William Zachmeler, 
•Margie Ruby, Erven Brundage and Marty Bauman 
for their assistance , , • you .have given 
generously of both your time and expertise, 

■^Remsrk&'by Wilson Riles, State Superintendent of 
' Public Instruction, Annual Conference for County- 
Superintendents of Schools and County Board of 
• Education Members, Agllomar, California, 
' kBTch 10, 197^. 
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Th^se remark;? <Urectly' praised the new linkage I 
created and th6 efforts of the planning teams working 
xinder my chairmanship, ^he State Superintendent of 
Public Instinictlon was /extremely pleased with the new 
working r^elationship and the county superintendents 
were equally pleased ♦ The new Joint partnership; a 
by-product of the practlcum, soon fcecatne the closest 
working relationship that these agencies had ever 
achieved. 
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15 ♦ 



C» Evaluation 
!• Product 

The final objective was completed In J?ctober 1974. 
The California State Department o/" Edubatlon now has 
a method that will provide , the data necessary to make 
decisions concerning tiie continued funding of ^ Individual 
consolidated programs. Specific Instruments 'and defin- 
itive procedures now exist which will enable the department 
to systematically monitor and review programs In 
California's consolidated delivery system. 

Completion of the milestones In my Practicum Proposal* 
Design and the Evaluation Criteria section represents 
more than a full ye air of Intensive work. The essen.tlal . 
products I planned now exist. When I proposed this 
effort and Joined my present manager in order to complete 
the system, I represented a work force of one person^ As 
objectives were successfully completed and products 
emerged, the work force slowly grew in slze*^ During 
October the.re- were thirteen professional and five 
secretarial staff working full time in this effort. 

With staff assistance,.! was^ responsible for pre- 
paring an evaluation of the Pilot Monitor and Review. 
A copy of this report, which reflerts the major {portion 

16 
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of my efforts, may be examined by referring to Appendix B, 
"Evaluation Report of the Pilot Monitor and Review." 
This report, v^hich was originally designed In the' prac- 
tlcum proposal, was officially presented to all of 
Calif orn^fa^s county superintendents during June 197^* 
The preface describes the overall purpose Involved. 

In order to desci^lbe the product evaluation, I 
shall relate ,the milestones in Prac tlcum Design and 
Evaluation Criteria to the objectives I established in 
my proposal to -our Cabinet. The products emerged from 
'these objectives^ The objectives may be found by 
referring to page 5 of Appendix C which, represents the 
proposal to Cabinet and page 1 of Appendix B, Evaluation 
Report^ of the Pilot Monitor and Review where they are 
repeated'. All of these subobjectives were designed to 
complete the final objective of the Practicum Proposal. 

' Objective 1 was stated as follows: 

n 

By February 1974, the California State Department 

of Education will establish a MAR system, including s 

consolidated MAR instrument (M-127), to be used to 

review all specially funded programs included in the 

consolidated application. /' 
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This objective connected milestones 1.1 - 1.3 of 
my practlcum Into the behavioral objective language 
which Is helpful In getting projects approved In the 
California State Department of Education. ^ 

QSils objective was achieved. Two basic products 
emerged from th^ effort: . (l) The Monitor 9nd Review 
Instrument (M-127), and (2) MAR procedures. These / 
products ^and the^ work Involved will be described In 
II. B. 5 and li.B.6\ They were complete prior to 
February 197^. 

r ■• ^ 

Objective 2 was concerned with eventually bringing 
add.ltlonal programs into the consolidated delivery system: 

By February 197^, auxiliary Instruments, will be 
prepared to be used for revl6w of selected specially 
funded programs not presently . inclu^ded In the consolidated 
application. 

' Auxiliary instruments were^not prepared, because 
I lost interest In this objective. They did not relate 
_-to--.the--niilestones-X_Jiesoliated in jny_re vised Practlcum 



Proposal. Since this would have been a very difficult 
^ .ask and It didn't relate to my newly -designed objective, 
I ^letly dropped this effort. 
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The third objective relatecji to milestones 1.4 - 1.7 
of my practlcum proposal. 

By July 197^, two departmental MAR teams with 
assistance from county office^ using the consolidated 
M-127 Instrument and auxiliary Instruments,'* will review 
consolidated specially funded -programs In twenty district 
(or multl-dlstrlct cooperations). ^ 

This objective represents the heart of my work 'In 
the practlcum. It was successfully completed and 
resulted in several products. 

Milestone 1.^ called for establishing a linkage 
with county education offices and securing eighteen 
full-tlnip equivalent staff positions assigned to work* 
with the California State Department of Education. I 
realized that I had developed something unique and very 
Important here and, therefore, placed considerable 
efforts In this area. These efforts will be described 
in II.B.4. 

• \ 

The product that emerged wa^ a new peer linkage 
of Joint planning with county offices. Liaison was 
established with the six area chairmen who represent 
all of the county offices l5(, California . This group 
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appointed a planning team of four, upon my request, to 
represent them. This planning team became a Joint 
planning team of eight under my chairmanship. Later 
the county offices assigned eighteen full-time equivalent 
person years or 5^ professional staff ^ to work In the 
pilot effort. From this total, 22 different Individuals 
actually participated for the full eighteen full-tlrjie 
equivalent person years. 

Milestone 1.5 was successfully completed and 

I 

resulted in a week long Inservlce session in Sacrame»to 
and Modesto. This staff development training was 
conducted under my direct supervision. The inservlce 
session was held March 12-15 and was attended by Hj 
county, district, and state representatives. 

Conducting the actual on-site reviews extended 
from March through May 197^. The original objective 
stipulated that 20 programs would be reviewed.- Due to 
the fact that three districts requested a one-year 
postponement, the actual number was 17. However, the 
number was -extensive enough to meet our requirements. 
Since some of these programs were cooperatives (several 
districts uniting under one application), we actually 
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reviewed more, districts and the pilot effort reviewed 
the consolidated programs In 7^ Indl^dual school sites. . 
A table Indicating the extensive naiJP of the Pilot 
MAR may be found by referring to page l8 of Appendix B, 
."Evaluation Report of the Pilot Monitor and Review", 

> 

Objective ^ related to esta'bllshlng a complaint 
procedures unit. 

Ey February 197^, the Department will establish a 
complaint procedures unit within the MAR structure 
which will respond, when appropriate, to citizen com- 
plaints, U.S. Office- of Education audits. General Accounting' 
Office (.GAO) audits, and legal suits. 

Materials 'and procedures for handling complaints 
have been developed by the State Department of Education. 
A complaint unit was not organized because of the I'eck 
of staff time and my inability to secure adequate staff. 
However, at least one monitor and review visit was matJe 
to a district in answer to an official complaint by 
changing my initial list of districts to be reviewed. 

Objective 5, relating to promising practices, was 
dropped due to lack of time. 
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The final objective, not indicated in the Pilot 



MAR Evaluation Report, relates to the 197^-75 school 



year. 



By Septenber 197^> the Department will revise and 
distribute the M-127 instrument to all districts which 
administer consolidated programs specially funded by 
th^ Department. 



my proposal. There was an obvious need to review and 
modify the instruments and techniques, based upon 
evaluation feedback. This objective, as modified, 
was completed. in September 197^. 

The California State Department of Education now 
has a revised instrument, PRI-127, and procedures which 
call for on-site visits to ^1^ schools in 71 districts. 



The description of this process modification will be 
described ^n II.B.13. 

Completion of this product came about in a far 
different manner frjom all of the previous effort si 
'The product is^qulte viable, but it represents a com- 
promise from some of my original efforts. By this time 
(July-August), a large number of units within the 
Department became intensively involved in the effort 




This objective correlates with milestone 1.8 in 
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because the emerging system was now cjulte operational 
. and affected their procedures and interests. 

This unanticipated difficulty, as reflected In 
my interim Progress Report, was caused by the fact that 
I was able to work full time on this* effort from 
November 1973 to July 197^. After the first year I 
was only able to work part time. By this time my . 
program manager was sufficiently Impressed with toy work 
on the monitor and review process that he began to 
assign extra responsibilities to me> e.g., secondary 
reform, clinical workshops for high school principals, 
career' education, industry education, and other secondary 
education responsibilities. For career advancement I 
agreed to accept these additional responsibilities and 
work less time in the monitor and review effort. After 
July I had opportunities to work on monitor and review, , 
but my time was somewhat limited. I moved from a role 
of direct Implementation to one with general strategy 
and review responsibilities. 

The revised system was different in some impoft"ant^ ~ 
ways. The instrument I prepared (M-127) was subdivided 
into school level and district level compliance. \A 
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new addition, which I was reluctant to add — quality 

rating— was included^ Thus, each school site will now 

I 

receive numerical quality ratings liy the^ monitoring 

team# "The new unit for next year will be titled 

« 

"Consolidated Program Rfevlew and Improvement". The 
functions, however, have not changed. Finally, addi- 
tional changes were made based upon the process evalu- 
ation conducted under my supervision. 

The final products then represent a major Input 
from a substantial number 9f people In the Department, 
the county office, school districts, and the community^ 
I may not have agreed with each modification, but the 
objective has been completed • Most slgfilf Icantly, the 
California State Department of Education now has a 
system fo3> monitoring and reviewing projects In 
accordance with the* primary objective stated In my 
practlcum proposal. 



24 



^20 



C# Evaluation 
2* Process 

The product evaluation Illustrates that the objec- 
tive established In the precticum w8s achieved. 
Furthermore/ the major subobjectlves and related tasks 
have been successfully completed* Recently, most 
educational endeavors have been Judged In terms of 
whether behavioral objectives have been met. In this 
case the practicum objective certainly has been met. 
However, the real merit or worth of this project may 
not be known for several years. 

Michael Scrlven, National Lecturer in Evaluation, 
addresses this kind of problem in Education Evaluation : 
Theory and Practice : 

"One of the reactions to the threat of 
evaluation, or perhaps to the use of over-crude 
procedures, was extreme relatlvlzatlon of 
evaluation research. , The slogan became: How 
' well does the course achieve its goals? Instead ^ 
of: How good is the course? But it is obvious 
that if the goals aren't worth achieving then 
it is uninteresting how well they are achieved. 
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^Michael Scrlven, Education Evgluatlont Theory and 
Prgctlce , Charles A. Jones Publlchlng Co., 
Worthlngton, Ohio, 1973, pege 73. 
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When someone Is aslted to evaluate a situation, or 
th3 Impact of certain kinds of procedures, what Is 
being requested Is an ana^lytl\:al description of the 
process* What are the causal connections. I.e., the 

Interpretations? ^Jl hBve therefore attempted to 

♦ 

Include the kind of process evaluation Michael Scrlven 
describes as outcome evaluation ^^n Intermediate stage: 
"This kind of 're search Is. of ten called 
process research, but It Is of course . slmjpile 
outcome evaluation" of an Intermediate stage 
In the development cf the teaching Instru- 
inent. . . There lis a distinction of role; the 
role of formative evaluation Is to discover 
deficiencies and successes In the intermediate 
versions of new curriculum; the role of dynamic 
hypothesis lnvestig?}tlon Is sul pienerls . ^ 

My, normal tendency has been to be task oriented. 
If the product of the original objective was completed, 
I was satisfied. However, in this effort I have dellber- 
ately attempted to estebllsh the worth of the procedure 
by continually appl^ring these "intermediate outcomes." 



' ^» cit., page 72. 
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Although the final ou^|om6 may hot be completely 
kiiown for several years, the process evaluation proce- 
dures indicate that the procedures have merit end that 
the outcome should result in positive educational change 

I have included a multidimensional evaluation of 
the efforts in the practicum. This multidimensional*^ 
evaluation is reflected in the following evaluation 
procedures: (l) the Evaluation of the Joint Inservice 
Program'; (2) the collection and reporting of data found 
in the official reports to the 17 programs reviewed, 
as reflected in the Evaluation of the Pilot Monitor 
and Review Program; (3) *he Field Evaluation Survey 
of the MAR Process; (4) the submission of the names of 
three persons qualified to observe my efforts and 
willing to answer questions from Nova University 
concerning accountabilitv, usefulness of the efforts, 
and observable results; (5) as required by Nova Uni- 
versity in a June "19, 197^ > evaluation of my proposal, 
I agreed to make three on-site inspections myself. 
The purpose of these inspections was to determine wh^the 
the teams performed their observations objectively, 
whether they did all the things I considered appropriate 
and whether the team reports provided accurate pictures 
of on-site reality* 
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The Joint Inservlce training session held in 
March 197^ was a critical element In this practlcum. 

r 

The purpose of theSe developmental sessions was to 
acquaint the part}.clpants with the Mrl27 Instrument 
and to enable the participants to utilize the Instru* 
raent effectively when conducting monitor and review 
sessions In the field, 

There were couhty and state participants. All 
but three responses to the evaluation Instrument by * 

those attending o/i thq last day were received, Stste 

r 

Department of Education st^ff Involved directly with 
program activities input did ^ not fill out evaluation 
forms, SvaluDtlon v;as both formal and informal. In- 
formal eval^,tion v;as conducted during and betw.een session 
by three observers who recorded responses received from 
participants. The complete report m.ay be examined on 
page 3 of the MAR Inservlce Evaluation Report in 
Appendix D, ^ ^ 

• 

Queistlonnalres were submitted to-each participant - 
who was asked to anonymously respond to the following 
questions: (l) VJhat was the most valuable part of t^ie 
inservlce program? (2) In what ways would you suggest 
that the training could have been Improved? 
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The tabulation' of responses are tallied In the 

i 

following chart: ^ 

RESPONSES TO THE INSERVICE TRAINING EVALUATION FORM 

The most Valuable Part of the Inservlce Program: 

t Number 
^ ^ Respond^K 

Going through the monitoring document w 

with a specialist In the field. . . . \ . . . 9 

Small group discussions • . . . . ' 10 ' 

Knowledge gained In specif I'c areas. ^ 2 

Relating to people from the State Depart- 
ment and the county offices 

Problem- solving (the final session) 4> 

The Human Relations Program 3 

Interaction of RST snd MAR Teems ^ 2 

Well organized inservlce. 3 

Suggestions for Iriorovement 

Pre-MAR visit team building simulation. ... 2 
Pre-MAR visit in a district 1 

More inse'rvlce on providing solutions to 

problems in the field. What was given was 

excellent . ^ , 

Additional inservlce after several field 
visitations • 

More discussion ' with speclialists in the. 

field • • 2 

Additional acquaintance with rules, and 

regulations - Title I, II, etc ^ , 

(Cbntinued) 
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None or no suggestions - it was well 

organized 2 

Continue present inservice. . • , . 1 

Additional team building • • • 1 

More do^s and don^ts sessions 1 

The overall results were quite positive. They 
indicated that I was successful in ray small cluster 
informational fair approach. I iiad been firm in my 
directions to move away. from the lecture approach. 
Evaluations of recently completed inservice session 
^ within the Department- strongly suggested that lecture 
techniques were not well received by professional 
staff members. 

The first two favorable responses pointed to the 
small group cluster teaohlng technique, i.e., going 
through the monitoring document with .a ppeGislist\in 
the field . . • 9 and small group discussions . • . 10. 
Since this was the heart of the entire instructional 
program, we were successful In our most critical effort. 

The most prevalent critical suggestions related 
to responses 3> snd 5« These responses indicated 

r 

that we attempted to accelerate too. much training of 
complex procedures, rules, and regulations in a rela- 
tively short time. 
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The Informal responses which were systematically 
, collected by three observers reinforced the question- 
nalres: 

INFORMAL EVALUATIONS RECORDED DURING 
INSERVICE MEETING 

, ' No, Making 

I Comments 

"This is the type of Inservlce the State 

should conduct . " . ^ 

(State) 

"The county is appreciative of an oppor- 
tunity to work with the state; this helps 

us both." 12 

(County) 

"The county wants to work in cooperation 
with the statue as this is planned, we do 
* not want to do it all." (Quite emphatic) • .. 9 

^ (County) 

"The small groups help us keep on the ball." 

"Small gl»oups are the onl^ way to go." 

"Small .groups are very superior to large 

groups for gettdng across information, etc." 11 

(state and 

' ^ ^ County) 

VThe interaction is terrific." 5 

' ^ , ^ (state and 

County) 

"'Could we have' more team building?" 2 

"We want more answers^ to problems, but I 

guess it*s my job to read the material in 

the- reference book." 3 

V 

"This is well organized. The meeting 

keeps moving. " 6 
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The Informal responses reinforced the positive 
value of the "-small group teaching stations. These 
responses also confirmed the value of Jointly working 
with county offices. Both county and state personnel 
were very enthusiastic about the new relationship. 

The collection and reporting of data found In the 
offlcljBl reports of the 17 programs was a very helpful 
process In analyzing .what we were- finding in the districts. 

^ The most commonly found areas of commendation in 



descending order were as follows:" 

Item Number 
^ ^ 

1.0 Instructional plans * . . 7 



3.0 Parent and community involvement 7 

4.0 Dissemination of information plan .... 6 

3.0 Parent participation • • 6 

1.9 Individualization of instruction o 



— Enthusiasm on part of staff 5 

2.0 Maintenance of effort ; ^ 

6.0 Fiscal administration ' . . • • 3 

5.0 Evaluation 3 



— ^Acceptance of constructive criticism . . 3. 
1.6 Parent education program .......... 2 



^Report of the Pilot Monitor and Review Progr&m, 
California State Department of Education, 1973-7'4, 
page 3. (Found In Appendix B) 
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Only those Items which were moat frequently commended 
are listed here. Additional Items with a frequency of 
one may fee found by referring to the Pilot Evaluation 
Report. 

The following data reveal the frequency of those* 
guideline areas in which non-compliance was observed:^ 
Item Number 

1.12 I^i^i^tlon and segregation 10 

1.9 Individualization of Instruction. ... 10 

1.2 Selection of participants ....... 7 

3.0 Parent and community Involvement. ... 7 

6.0-^ An Inventory of all equipment costing . 

over $100 ^ . . . . . 6 

1.6 Staff development 5 

1.11' Mlnlmuk. and maximum levels of service . ^ 

5.0-7 Evaluation of program management and 

logistics plan 4 

3.0-7 Each member of DAC was furnished with 
federal i^ulations, guidelines, state 
regulations » 4 

6.0-6 Assurance of compliance ........ ^ 

6.0-7 Items labeled to show year of purchase. h 

^ 4.0 Dissemination of information 4 

1.13 Nonpublic school participation. .... 3 

5.0-1 Clearly stated measurable performance 

objectives , 3 



70p. cit., page 5. 
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5.0-3 Process objectives design 3 

6.0-2 Periodic reports 3 

7.0-1 Management system 3 

1.8 Identification of resources 2 

5.0-8 Process evaluation data . 2 

5.0-5 Analysis design . 2 

3.0-5 More than simple majority parents of 

participants 2 

6.0 Fiscal admini strati on . 2 

1.3 Needs assessment 2 



Additional Items vhlch o-;c\j?red with a frequency 
of one may be observed In the Pilot Evaluation Report. 
The most troublesome areas were l."l2 through 6.0-^. 
Isolation and segregation referred to the grouping of 
children. California does not allow rigid ability 
grouping, but some districts have had difficulty complying 
with this requirement. California also requires Indivi- 
dualized Instruction. The level of state understanding 
of the art Is Incomplete and schools need assistance In 
the area of Individualized Instruction. 'The selection 
of participants, i.e., the pupils who receive services 
Is Important, but apparently misunderstood. Defining 
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who are the most educationally disadvantaged has 
proven difficult. Parent Ihvolvement has also seemed 
to be a requirement that was difficult to Implement. 

Gathering this data for the evaluation proved to 
be Invaluable, for It served as evaluation feedback for 
the ongoing pilot review as the frequencies began to 
emerge. We were able to use this Information to brief 
Consolidated MAR staff each Friday. Information was 
provided to consultants concerning what to look for In 
the next week»s visits and how to provide on-site 
consultative services to that district. Perhaps the 
major value of the pilot review, which ironically was 
not generally reflected in the official report, was 
the consulting services offered by the professional ) 
staff conducting the on-site reviews. As will be seen 
in the evsluatlon, districts were overwhelmingly appre- 
ciative of this technical assistance. Page 6 of the 
report indicates that we were determined to create a 
positive attitude toward program Improvement at the 
school and district level. School staff at the exit 
interview and in the evaluation survey of the MAR 
process confirmed that the process succeeded in this 
endeavor. 
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The Field Evaluation Survey of the MAR process 
was conducted after all 17 programs had received an 
on-site review. During June 197^ I asked staff to 
contact each district which was visited to respond to 
i^tructured questions. Fiscal limitations and a severe 
time constraint In preparing our evaluation report for 
the county superintendents and the fact that most admin- 
istrators would be on vacation in a few weeks, dictated 
a structured telephone survey. 

We received 3^ responses from schdol administrators 
to the following questions: 

!• . What were your impressions of the Monitor and 
Review unit? ( 
. 2. How were school programs changed as a conse- 
quence of the MAR visit? 
3. How could the MAR process be improved? 
'Answers to those questions were tabulated and appear 
In Addendum I to the Report of the Pilot Monitor and 
Review Program^ 

Answers to the first question revealed that we 
indeed created a positive environment. This was very 
Important to me, because I believe this is the most 
enduring method of ensuring long range improvement. 
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Ihe MAR process was perceived non*threatenlng and 
quite helpfiil. District administrators believed our 
MAR processes were objective and that omt on-site and 
written suggestions were helpful. Our professional 
staff was also generally perceived to be competent* 

Answers to the second question^ l«e«t how districts 
were changed, were quite revealing* Our most troubled- 
some area. Individualization of Instruction, was one of 
the areas where we were most successful In achieving 
change* Districts clearly Intended to reform In this 
area by attempting to Improve the methods of utilizing 
techniques In the Individualization of Instruction* A 
large number of the districts were also committed Jto 
Implementing the specific recommendations for Improving 
the program which were offered by our staff. Our recom- 
mendations proved to be of great assistance in enhancing 
the changes the program directors wished to make. 
Districts also made substantial improvements and revisions 
In their procedures for identifying eligible students. 

Item 3» "How Could the MAR Process be Improved" 
tended to reveal minimal criticism. District staff seemed 
to believe that we should spend a longer period of time 
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In the schools or have additional staff. Some also 
asked us to conduct two exlt_ Interviews, I.e., one for 
the district staff and one tor general staff members, - 
parents and aides. There was a very strong direction 
^'or us to make follcw-up visits to the schools In order 
to ascertain implementation of Improvements' that would 
be made In relation to our recommendations for change • 

As we conducted our Initial structured Interviews, 
the conversations became quite lengthy. Obviously, we 
did not Include enough categories in the evplustlon, 
for district steff Insisted on making additional Input. 
V/e therefore stooped end- immediately categorized this 
new input in terms of questions for all districts. 
Through a proce^^3.\of content analysis it v.as categorized 
under 10 heeding^^;^ 

1. What program changes were made in the district 
directly sttributsbli to the MAR visit? 

2. Were the recommendations made st the exit inter- 
view implemented, or have plans- been m?de to 
implement the recommendations? 

3. Was the time the MAR team spent in your district 
adequate to indicate the needs of your program? 

1», (a) Has^your 4lstrict superintendent (have you) 
received your final program review report? 
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(b) Was the final report helpful in giving 
directions or alternatives for Improving your 
- program? 

5. in what ways was the MAR visit beneficial to 
your staff? ^ 
• 6. Would you like to have the MAR team follow up 
• with concrete program Improvement suggestions 
In your .district? 
7. What was the Impact of the MDnltor and Review 
team visit on your school district program? 
. 8. Other comments. 
9. Alternative suggestions. 

Q 

10. What changes would you make in the MAR process? 

with the exception of category 7, I was unable to 
compute any frequency distributions; nevertheless, the 
information proved to be highly significant In evaluating 
the pilot effort. Many of the conclusions in the MAR' 
report were based upon this Input. The reader should 
analyze pages 13-17 of the report to gain an Impression 
of the actual Input we received. 

The following table completed from ' category 7, re- 
lates to the products and the Impression of MAR results 



S0£. cit .. pages 13-17. 
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In the dlGtrlct;9 

Products of Objectives: Impression of MAR Results 

In Your District: 

• Excel/ Good Fair Poor 

1. The use of the M-127 
Instrument In reviewing 

program requirements: ^ 8 

p. The field visit . 3 9 

Final MAR exit 

Interview • 4 3 

. F'lnal written 

report 3 . 7 

2. List of commendation 10 7 

3« List of non-compli- 
ance 10 5 

k. To provide on-site 
assistance to the 

projects 6 4 1 

5, To effectively assess 

extent of compliance 5 6 

6, Effective MAR procedure 
to prevent future 
problems in the district 
through the : 

a. Pre-vlslt i 5 6 

b. Field visit 4 9 

c. Exit interview . . 6 10 

d. Report to district V_ 9 7 

7, Create positive atti- 
tude toward program 

improvement \5 2 \ 

8, To recommend chsnges 
vital to program 

quality 13 4 



cit , ^ page 16, 
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In conclusion, the evaluation indicates that the 
objectives were accomplished. The team and the proce- 
dures were well received. The instruments surfaced' the 
kind of information needed to prepare the official 
reports. The reports tended to reflect the status of 
the projects. No district disputed our reports; the 
reports were received as generally accurate assessments 
of the educational programs. When our teams left, the 
districts had a positive feeling and a sincere desire 
to improve their programs. The members of the teams 
continuously reported this reaction. The evaluations 
of our effort by district adr^.inistrative staff confirmed 
these reports. 

What made this evaluation report most gratifying, 
was the fact that this was the first monitor and review 

1^ process that allowed district staff to evaluate our 
staff. I had originalJ^bjeen uncomfortable with this 
evaluation, because districts can manifest harsh reac- - 
tiv'>ns to review efforts. This was a high risk, high 

; gain evaluation. Fortunately, our system was sufficiently 
positive and systematic, becauF.e the MAR teum evaluation 
report was qiite favorable. 
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The evaluation report demonstrated that tMe monitor 

ancL review process developed Into a successful nteans by 

Vfhlch schools were made aware of non-compliance and also 

motivated to Improve programs. The l^ams worked as a \ 

unit with ejccellent cooperation be tweenl county office \ 

■ ' ' \ 

and State Department members. The M-127 Ir^g^rument 

ft 

proved to be effectlvci In Identifying the areas of 
non-compliance and In clarifying the requirements of 
state and federal Ip'-'c. 

The evaluation report also enabled us to draw 
conclusions and make recommendatlori3 to the unit which 
would follow our efforts on a large scale during the 
next year. The report concluded that the monitor and 
review effort should continue In operation and that It - 
should continue as a Joint efCort with county offices 
in the same democratic spirit that made MAR successful.' 
The report recommended that- we should- modify our instru- 
ment to lnclu:3e quality assessment. This substantive 
change was recommended because of pressure from within 
the departrr^nt and from some legislative representajcives. 
If we were to be required to redTJe^ or expand funding 
for some projects, a numerical system^ would enhance 
comparative techniques. The second substantive modlfl- . 
cation Included an attempt to more definitively separate 
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the function to be performed" at both the district level 
and the school level. ^ 

The total llstfof^ recommendations may be found on 
pages 8-9 of the Evaluation Report found in Appendix B. 

As requ^^red by the Director of Practlcums, an 
additional evaluation was added/^ The additional require- 
ment called for personal, on-site follow-up visits. 

■> * ' 

Seventeen programs were reviewed, and* I agreed to person- 
ally conduct follow-up visi-ts in three programs. 

^ The purpose of these visits was to determine 
whether the teams performed their observations objectively 
and according to the proposed procedures* I personally 
travelled to the sites, contacted the project director^ 
and staff, and visited classrooms. 

' These three .personal on-site evaluation visits were 
conducted in Lompoc, Modesto anci Pajafo Valley. I'hese 
districts represented a cross-section and geographical 
dispersion of sites the teams visited. As I conducted 
these visits, I attempted to make the following deter- 
minations: 

- 1. Did the team follow procedures in scheduling, 
advance assignments, district orientation. 
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on-site activities, the exit interview., Srjci the 
' report? 

2, Was the final report based upon an accurate 

picture of on-site reality? ^ 
3* Did tF^e team create any problems? v 
'4. Was the positive approach manifested? 

5. Did our team provide op-site professional 
advice and technical/ assistance? 

6. Were the 'county staff I recruited helpful? 

7. Has the district begun to use the official 

written report, to take corrective action and 

If 

to ent^i^nce the program? 

Personal On^Site Evaluation 
Lompoc , Unified 

Lompbc Unified School District has a student pop- 
ulation of 11,992. The district is loceted in Lompoc, 
the flower capital of the world. Lompoc "is a city of 
' 26,000 located approximately six -miles from the Pacific 
Ocean and 50 miles north of Santa Barbara. Vandenburg 
Air Force Base and a recently made famous prison which 
serves as the home for some famous Washlngtonians are 
significant features which identify this city. 

I 
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I * 

Our Monitor and Review team visited this district 

. \ 

^ on May 21-23, 197^* I conducted -a follow-up Inspection 

^ ''^ 
for evaluation purposes on October . 22, 197^^ In or3er 

to determine answers to the following questl9ns: 

1. Did the team- fallow procedures in schecjul'ng, 
advance assignments, district orientation, on- 
rite activities, the exit interview, and the 
report? ' 

Our visit to Lompoc was an exemplary model. According 
to. the district ct^ff, i.e., pro,ie(f\: director, prin- 
cipals, teachers, all procedures were followed exactly 
as I had planned them. The team showed up on time, 
conducted the orientation Snd the ^slt, and held an 
exit interview. The exit interview was a very exciting 
evening session which was open to the\?ntlre -community. 

Our team leader was very Innovative in cremating this 
setting for the exit Interview, The evening session was 
not what I had anticipated, but It was very desirable, 

2, Was the final report based upon an accurate 
picture of on-5lte. reality? 

The team had rated Lom^^oc's currlcular program ^ 
rather well. My on-site evaluation confirmed this Judgment, 
The program in the school was quite strong, the school was . 
in general compliance, and the educational, quality of the 
program was good, 
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Our team had rated some areas weak, e.g., parent 
Involvement. I found that the schools were taking 
corrective action, for example, one school had hired 
a parent coordinator to correct the weakness our teajm 
Identified. 

3. Did the team create any problems? 

The team Interviewed the Associate Superintendent 
and Director of Curriculum. I also interviewed both 
Individuals and found that both were pleased. In all 
respectsi with our team. 

4. Was the positive approach manifested? 

As I talked to teachers, aides, principals and the 
director, it became clear that our^ team achieved this 
objective. 

5. Did our team provide on-site professional advice 
and technical assistance? 

Our team was percelvpd as very strong in curriculum, 
organization and parent Involvement. The team freely 
gave, recommendations on a fornnal and informal basis. 
Individual conferences, dialogues with teachers and 
community meetings were settings where this assistance 
took place. 
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6. .Were the county staff I recruited helpful? 

Tuo county staff members participated. The district 
staff did not perceive them as separate from the team# 
When I Indicated their role during the follow-up visits 
the project director and a principal reacted very 
favorably to their Input as Individual professionals. 

?• Has the district begun to use the official 
written report to take corrective action and 
to enhance the program? 

The district has responded energetically and 
positively to every recommendation. The district Is 
strengthening Its program for Individualizing Instruc- 
tion. As I Indicated earlier, the program was somewhat 
weak in the area of parental Involvement. Since our 
visit, a massive restructuring of this component has 
begun and new personnel have been hired to provide 
leadership at the school level. 

Personal On-Slte Evaluation 
Modesto CI 

Modesto City School District Is In the center of 
> California's huge Central Valley. Although the backbone 
of the economy Is agricultural, recent events have brought 
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a massive migration to the area and a more diversified 
economy. 'The district Is rather large and Is responsible 
for the education of 21,881 pupils. The student popula- 
tion represents all socio-economic and racial segments 
of the society. 

The follow-up visit to this district did not occur 
until December 13, 197^ • Thus, there were some problems 
In assessing the value ^of the review. However, there 
were some advantages Ijfi the delay, because It provided 
an opportunity to dete/rmlne actual compliance on a long 
term basis. Based upcin answers to the following points 
of Inquiry, It Is obylous that the review had a positive 
effect. 

• 1. Did the team follow procedur'es In scheduling, 
advance assignments, district orientation, on- 
site activities, e exit interview and the 
• report? * , 

The team followed all procedures delineated- In the 
schedule. Advance arrangements were* made, the team showed 
up on schedule, and conducted the orientation, review 
and exit Interviews according to the timetable. This 
accomplishment was made In spite of a serious setback. 

/ . ■ ■ 
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The team leader and two State staff members were 111 
and unable to participate. The remaining part of 
the team accomplished the mission by following a reduced 
schedule . 

2. Was the final report based upon an accurate 
picture of on-site reality? 

Based upon my observations, the, report reflected 
an accurate assessment of the actual program. Most of 
the strengths and weaknesses I was able to detect were 
those Indicated in the report. 

3. Did the team create any problems? o 

The only problem the team created was the required 
reduction iti the schedule. The burden of revising the 
schedule fell upon district staff. 

4. Was the positive approach manifested? 

> 

District staff enthusiastically pral-2d the positive 
attitude and behavior of the team^ The team members 
created no problems and were quite helpful to the district 
staff. 

5. Did our team provide on-site professional 
advice and technical assistance? 



FRir 




The team provided on-alte professional advlee which 
enhanced the quality of the educational program, district 
staff, with the exception Indicated in "7," were recep- 
tive to this assistance, 

6, Was the county staff I recruited helpful? 



County staff was more than helpful. They actually 
prevented this review from falling. When State staff 
was unable to attend, a main, part of the burden actually 
fell on the coianty staff, 

7. Has the district begun to use the official 
written report to take corrective action and 
^ to enhance the program? 

My review confirmed that the district has taken 
corrective action. Most recommendations of the report 
have been rigidly followed. Program components and objec^ 
tives. have now been specified. A dissismlnation plan has 
been introduced. The evaluation report now contains a 
written end product evaluation at each school. 

The district did take issue with part of the report. 
It recommended that the program staff should have line 
authority. The district position was that this recommen- 
datlon was contrary lo their policy. In this area, it is 
my opinion we made an inappropriate recommendation. 
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Personal On-Slte Evaluation 
Psjaro Valley 

Pajaro Unified School District lies In the lettuce 
center of the world. The district' consists of an unusual 
25 mile-long narrow strip. Vithpi this strip there Is a 
Wide range of students consisting of extreme socio-economic 
and racial diversity. The district serves high scoring 
affluent children from the dominant population and low 
scoring poor children who are Mexican-American and poor 
white In background. 

1. Did the team follow procedures in scheduling, 
advance assignments, district orientation, on- 
site 'activities, ^ the exit interview, and the 
report? 

The team basically followed the procedures I devel- 
oped. However, there were some serious discrepancies. 
The advance arrangements were poorly made. Communica- 
tions did not proceed from the district's project coordinator 

to tU3 dli^trict r:tr-f. \ 

\ 

\ ^ 

Our Monitor and -Review team was very late during the 
district orientation. Due to a misinterpretation of direc- 
tion only one of our team members showed up, on time. Most 
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team members went straight to the schools and this 
caused bad feelings on the part of some district staff. 



The exit interview did not proceed smoothly. It was 
held In the evening. The tone of the meeting became 
too Informal due to some poorly arranged procedures 
during the dinner hour. 

2. Was the final report based upon an accurate 



The team report provided a generally accurate 
assessment of on-site reality. The two primary wealcnesses 
detected were fJoor parental Involvement and a lack of 



Individualized Instruction. During my on-site Inter- 
view I observed the same weaknesses. 

3. Did the team create any problems? 

The team created problems by being late the first 
day. This one incident damaged the credibility of the 
entire team. 

4, Was the positive approach manifested? 

The team was well received and created no new problems 
for the district which were beyond the normal ones ex- 
pected from a reviewing group. Tip tesm was- generally 



pictiore of on-site reality? 
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perceived as being very positive. The primary diffi- 
culty was the tardiness of our team. 

5. Did our team provide on-site professional 
advice and technical assistance? 

The on-site professional advice and technical assls- 
tance varied. Some team members were quite helpful. 
Unfortunately, others communicated that professional 
assistance was not their responsibility. Somehow, some 
of the staff received the erroneous impression that their 
only responsibility was to monitor and review. This 
serious misunderstanding has been corrected as a result 
of the on-site visit. 

I 

6. Were the county staff -eir.tors I recruited helpful? 

The county staff members v;erc quite helpful and well 
received by the district. However, I discovered that 
the local district strongly believes tljat their 
cobnty staff should not monitor and review in their 
own cpunty. County staff serve a>i^con^jd^ai^ to the 
dist/lct 8. District staff believe that Mhay should 
not attempt to play both roles, I.e., dpveloper and 
Inspector. 
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7. Has the district begiin to use the offlcis*! 
written report to take corrective section and 
to enhance the program? 

I us 8 gratified to find that the district has 
seriously begun to take corrective action. , There had 
been considerable activity to correct the weaknesses 
our team encountered. Particular attention has been 
given to Involving parents and strengthening the Indl- 
vlduall^ed Instructional program in those schools where 
It was weak« 

In the\schools I visited, district staff was able 
to deraohstrate the changes they had made since the 
review. Moreover, I was actually able to observe the 
changes being made in the classrooms. 



r 
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PART II: Executing the Practlcum 

A. Gteneral 

The practlcum represents more than a fundament«»l 
educational change. The effort <has also directly affected 
my work status. In order to accomplish this practlcum, 
I actually changed -Job assignments. My original proposal, 
which grew out of my Nova University proposal, was 
accepted by my present program manager who asked me to 
Join him ^n order to accomplish the objective. 

The work began In November 1973. Approval to 
begin official work was granted by Nova In January 197^* , 
The total time expended on the effort was nore than a year* 
The f j.rct nine r.orirhc ;.'cre clno^-.t a full-time effort. The 
renicinaer constituted a part-time assignment consisting 
of review activities and providing general direction. 

As I have indicated, an ERIC search failed to 
reflect any consolidated monitor and review efforts. 
Hov;ever, an earnest consolidation .moverTient in the develop- 
ment of programs nay be found in the Comprehensive H3V/ 
Simplification and Reform (MEGA) Proposal. This was a 
comprehensive Health, Education and Welfare (HEW) simpli- 
fication and reform effort which was designed to simplify 
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and decentralize new ^Initiatives. In health Insurance,. 
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student aide, vielfare reforfn, by consolidating programs. 
The ratJLonale for this- movement may be found In, Hearings 
Before the Committee on Labor and Public Welfare, U.S, 
Senate. Ninety-Third Conp:ress . ^ - ^ .... 

Consolidated program development began In California, 
on a pilot basis In 1969. During 1973-7^* California 
had developed a statewide system of consolidated program 
development. The intent of this practlcum was to 
develop the first consolidated monitor and review system 
which had the caprcity to exsmlne these programs In 
accordance with the established objective. 

California had developed a consolidated approach 
with two distinct functions. It vas a consol? 'Nation of 
resources, i.e., funding and a consolidation of educational 
programs. Moreover, the system was designed so that It 
could be consolidated into any pattern. As new programs 
emerged, the delivery system could absorb new programs. 

Less emphasis v.-ss placed, upon the c/umbersome, 
traditional system of controlling quality by means of 
an application. Indeed most of the fundamental school 

• -N ■ 



^ ^earlnr!;G Feforc the Commlttoe on Lg-bor and Public 
Welfare, U'.o. ^onnco, Ninoty-ThlT-d Congress. Frr:e 12 . 
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level plans stayed In the district's file. Thus, in * 
order to ensure that individu'al-^.prpgrams were Implemented 
In accordance with the various laws to determine connec- 
tions between the programs and to ensure that fuiids were 
being used optimslly in tei^a of the total activity at 
the site, a thoro'Agh system of on-site monitor and 
review needed to be developed! Such a syatem would ^ ■ 
enhance the consolidated effort and ensure that, as 
much as, possible, the individualized needs of the recip- 
ients were being met. 
<^ 

An excniination of the primary tasks involved in 
executing the practlcum will illustrate how the prScti- 
cum was completed. 
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p. Accojnplishment of Tasks ^' 

1, Requesting Cabinet Approval 

Approval .of major new activities within the California 
State Department of Education requires Cabinet approval. 
The Superintendent of Public Instruction has appointed 
a small group of key staff members who are responsible 
for passing Judgment on the myriad of requests for new 
undertakings. TKls is a group representative of the 
various department units who can analyze the diverse 
requests in terms of a high level and total organizational 
perspective. Thus, the first task to be accomplished 
was 'to seek approval at this level. Since there are 
more requests than the Department could possibly under- 
take with available resources, securing approval for a 
new endeavor is most arduous. One must do his homework, 
demonstrate a need, illustrate how the program will be 
implemented, and how it will be assessed. 

Prior to requesting Cabinet approval there are, of 
course, other significant "buy-off s" whicn must be secured. 
The primary person was an individual who eventually 
became my manager. At that point in time, the Superin- 
tendent of Public Instruction had decided that any 
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activities related to monitoring of programs would be 
assigned to^ .the Associate Superintendent for Secondary v 
Education. Securing his approval for the activity was 
vital. 

During this period of executing the practlcum,! 
was totally alone. I had not yet officially submitted 
a proposal to Nova, I had no staff, and. Indeed, I was 
In another unit. Fortunately, the program manager was 
anxious to move li^' thls^rea because pf- his long raAge 

I 

responsibility. We thoroughly discussed the plan and 
agreed to seek Cabinet approval. , 

r 

There were monitor and review functions being 
performed at this time, but they were not consolidated 
In isny way. Although the Department had managed to 
'develop^a very Imaginative consolidated application and 
approval system, categorical units within the organization 
continued their unlt-by-unlt monitoring system. 

I commenced the practlcum effort by myself. I 
prepared the conceptual fr^^mework for the new plan by 
Illustrating our legal requirements, discussing the 
proposal with my manager and developing the* Initial 
objectives, and a few hlghlJrht activities. Two str6ng 
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currents were operating which influenced the effort. 
First, the Department had initiated a consolidated 
application, and it wag 'illogical not to review programs 
In a similar- fashion. Second, the program manager 
strongly desired the development of a monitoring system. 

In order to establish a legal argument, I analyzed 
the following sources: ESEA Title I and II; P.L. 89-10; 
Federal Register, Title 45, Part ll6; and California 
Administrative Code, Title 5. The law was clear, i.e., 
the State Department of Education had the legal right 
and responsibility to 'monitor these specially funded 
programs. 

The Federal Government recognizes that state 
departments of education have the legal authority to 
approve and review programs: 

Federal Register, Section 116.23 (Reports by local educa- 
tion agencies. ) 

"Each application bjL^a local educational 

agency (including a State agency directly 

responsible for providing free public education 

for handicapped children or for children in 

institutions for neglected or delinquent 

children) shall provide assurance that it will 

V 

1 




56 



render to -the State educational agency en 
annual report and such other reports, in such 
form, and containing such information, as 
may be reasonably necessary to enable the 
State educational agency to perform its duties 
under Title I of the Act, including the measure- 
ments of educational' achievement and program 
effectiveness required by #ll6.22. The local 
educational agency shall keep such program 
and fiscal records, and afford such access 
thereto, as the State educational agency may 
find necessary to assure the correctness and 
verification of ^uch reports and the expendi- 
ture of funds granted under Title I of the 
Act."^^ 

Section 39^0 of the California Administretive Code, 
Title 5, also requires that upon request of the Superin- 
tendent of Public Instruction, school districts' 
records shall be made available for inspection to 
verify the accuracy of reports and to determine the 
conformity of program. This administrative requirement 

^^ Federal ReR;lster , Vol. 38, #213, Part lOO(b); 
Title ^b, Parts 116-117, Section 116.23. 

•'•^California Administrative Code . Title 5, Section 39^0. 
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is legal *hen approved by the State Board. of Education. 
It Is based upon the following laws: ^3 

1. California Senate Bill 1302, Early Childhood 
Education program, California Education Code, 
Division 6, Chapter 6,1, Sections 6^^5-6^4146.6. 

2. California Assembly Bill 228^4, Bilingual, 
California Education Code, Chapter I258, 
Statutes 1972. 

3* California Senate Bill 90, Educationally 
Disadvantaged Youth, California Education 
Code, Chapter 1^06, Statutes 1972. 

I was also able to establish that continuity of 
funding to the stste and districts is dependent upon 
our monitoring and review responsibility: 
California Administrative Code, Title 5; Section 39^1*" 
Continuity of Funding 

"Districts maintaining programs under 
this Chapter shall have their programs approved 
for a period not to exceed three consecutive 
years contingent (l) upon the availability 
of funds, (2) upon compliance by the district 

^^Senate Bill 1302, CEC Section 6^4^5^16,19; Assembly 
Bill 228^ - Bilingual, CEC Section 5761.1; Senate 
Bill 90 - ECE, CEC Sections 6^99*236 and 61499.237. 
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with the rules promulgated by the State Etoard 
of Education and the State Superintendent of 
Public Instruction, and (3) upon an annual 
evaluation which demonstrates that the program 
is not one of low effectiveness. 

if 

Thus, we had the clear authority to monitor and review 
programs. 

Since I wanted to Include a provision for Identifying 
promising practices and disseminating their results, I 
continued to search the law. Both of these concepts, 
which were later to be included in the original proposal, * 
were also within the federal law. 

The legal ramifications were used to illustrate 
legal requirements to the key decision makers and later 
to the Cabinet. Being able to delineate the actual 
sections within the law facilitated the approval process. 

Immediately after establishing this groundwork, I 
was asked to prepare an official request. for Cabinet 
approval. At this point the effort grew from one 
person to two, I received part-time assistance from 
one person in the Secondary Age-Span to help me prepare 
the report. ' I 

l^California Administrative Code ^ Title 5, Section 39^1. 
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My main argument In the proposal was that the 
superintendent of Public Instruction^ had reorganized 
the Department so that a new delivery system would 
provide a comprehensive approach to education. In order 
to meet the highly Individualized needs of students In 
California's- pluralistic school systems, I reinforced 
the fact that the Department of Education must provide 
a delivery system which encouraged local districts to 
Implement previously fragmented programs within a 
consolidated framework. The new delivery system consisted 
of comprehensive district- and school-level program 
planning and consolidated applications for funding. In 
order to complete the process, I took the position that 
we immediately, needed to develop a consolid<ated monitor 
and review process. 

The heart of the proposal was built upon Popham's 
discrepancy model. This model begins with an analysis, 
of "what Is." Then it moves to "what ought to be." 
Hhis procedure reveals a discrepancy between reality 
and what Is desired. Then one can logically build 
objectives. Afterwards, the activities fall Into place. ^5 

1 3An Evglurtlon Guidebook , W. James Popham. The 
Instltutionci Objectives Exchange, Box 2^*095, 
Los Angeles, California, -page 2. 
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In analxzlng what Is, I described hovf the Department 
has traditionally administered specially funded programs 
on an independent basis. Thus, each had required separate 
plans, regulations, grant applications, and monitoring 
activities, I reinforced the fact that this fragmented 
approach tended not to focus on comprehensive needs of 
individual students, • 

The analysis of "what is" highlighted the situation 
wherein the Department's system of administering specially 
funded programs often required e?ch program's limited 
staff to direct their monitoring efforts •toward compliance 
with legal requirements and minimum project standards,' 
This approach was often done on a relatively subjective 
basis. These reviews tended to highlight program weak- 
nesses and did little to generate efforts to improve 
the quality of individual projects or to create a com- 
prehensive school progi^am. 

The essential part of the report next moved to 
'^what should -be," i,e,,-the desired conditions, 1 
took the position that the Department should establish 
a consolidated monitor and review system for all specially 
funded programs it administered. Such a system would 
consolidate administration of the various specially 
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funded programs so that all monitor and review serv zes 
nould be provided by a single integrated unit. Integrated 
administration would eliminate the duplication of paper 
vork, the need for multiple field visits, and the 
conflicting directions that occur when each program is 
administered separately. With a functionally oriented 
administrative system, specially trained staff would be 
able to conduct more objective, systematic reviews. 

f 

I argued further thet a Consolidated Monitor and ^ 
Review system would encourage local districts to 
implement specially funded projects on a comprehensive 
basis. Such a system would require districts to focup 
on their total program by providing comprehensive 
reviews that stressed the need for integrated programs 
which would meet the broad range of students' needs. 
Consolidated reviews would also examine multiple 
dimensions of project accomplishment, thereby adding 
to the formal achievement data which had historically 
been collected.. Such assessment would be done cooper- 
atively, emphasizing school and district cooperation 
in a 'careful examination of t^elr strengths and 'weaknesses. 

0 

Finally, I took the position that a Consolidated 
Monitor and Review System with a well trained, permanent 
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staff would be better equipped to emphasize program 
strengths and Improvements, While compliance with 
legal requirements would be met, the major focus would 
be directed toward giving recognition to Innovation and 
imagination, and promote a common pursuit of successful 
comprehensive program Improvement that would result In 
superior levels of student achievement. 

My next step In my model for requesting Cabinet 

appjroval wao to establish objectives. It Is appropriate 

at this time to restate my overall objective. The 

overall objective of my proposed plan, which I refer to 

as Consolidated Monitor and Review, is to devise e 
i ^' 

method thtt will provide the data necessary to meke 
decisions concerning; continued fundinr; of individual 
consolidated Drop;rams . A monltorinr; instrument nnd a 
technique v.^ill be developed ;:hlch will provide this 
data . In securing approval for this objective it was 
necessary for me to 3t->te sub-objectives. These sub- 
objectives were necesc because they corresponded to 
the discrepancy basec' model and were in the parlance 
of the. bureaucracy. These objectives will not be 
repeated here because they were presented In jPart I. 
They may be recalled '''by referring to that section or 
Appendix C, "Consolidated' Monitor and Review Procedures. 

G7 
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In summary, the objectives originally requested 
approval for two school years, 1973-7^ and 197^-75. 
They were not all approved. However, they were approved 
for the 1973-7^ school year. Approvaf for 197^4-75 came 
considerably later. Cabinet members approved the nllot 
effort and asked us to return with an explanation of 
how our delivery system related to other organizational 
units within the Department. 

In response to the concerns ahd directions emanating 
from Cabinet members, I prepared a series of statements 
describing the interaction between the Monitor and 
Review Program, the Regional Service Teams, the Early 
Childhood Education team end the Office of Evaluation. 
This dQcument of organizational units was submitted to 
other units for their reaction. 

In this document I proposed that six Monitor and ^ 
Review Teams be ectrblli>iitrd for the 197^-75 school year. 
This number corresponded to the Regional Service Team 
structure, thereby promoting stable working relationships 
between two teams assigned to a geographical region. The 
Regional Service Teams are responsible for approving . 
district programs. I proposed that two groups perform 
their duties In a coordinated manner. 
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In order, to maintain close liaison, it was proposed 
that the Monitor and Review Teams and a member of the 
Regional 'Service Team would review the district's program 
prior to a 'visit to that school district. The details 
of this review would be developed together.- A copy of 
the Individual Monitor and Review reports describing 
each district would be provided to the Regional Service 
Team. In addition to this collaboration, when any policy 
questions arose related to a visit, the Monitor and 
Review administratoi^ and leaders of both regional teams 
would meet to determine what problems existed in the 
district program and what steps would be needed to resolve 
them. This type of coordination was designed to eliminate 
Cabinet fears of the possibility of multiple, possibly 
conflicting instructions being given to a school or 
district by two teams. , 

The two teams, while operating in the field simul- 

V 

taneously during the January-May period, would have 

Si 

different resporfsibillties. The Monitor and Review 
team would be monitoring a district's implementation 
of their instructional program (approved by the State 
Board of Education the previous June),. while the Regional 
Service Team would be assisting- the' district with their 
next year's plan and appropriate application for funds. 
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Coordination would be maintained so that both teams 
would not be In the district at the same time. 

During the pilot phase of Monitor and Review, the 
Monitor and Review Program Manager, Monitor and Review 
Administrator, and Monitor and Review Team Leaders would 
meet with equivalent Regional Service Team personnel 
to assure field coordination. 

This plan ^.Iso called for use of Regional Service 
Team members to participate In the monitoring process 
during September rnd October. There were several 
reasons for this utilization: (l) The Monitor and 
Review teams would be enlarged, thus allowing direct 
visits to a greater number of schools In the large'st 
districts, (2) Regional Service Team members would 
ha\e a first hand view of how the Konitor and Review 
process complements the Regional Service Team efforts 
to avsslst districts In planning and Implementing com- 
prehensive educational programs, and (3) such participation 
woula better cn?.uvo ccrj tenuity tet^veen the coj'or^hsncivc 
planning/consolidated application phases and the Monitor 
and Review phases of the delivery system. 

This revised plan called for a change concerning 
the Early Chllahood Education Program which was already 
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implementing an assessment process. It v?as proposed 
that the^Early Childhopd Education Management Team 
maintain responsibility for monitor and review, of those 
schools receiving such funds for a number of reasons* 
Early Childhood funds are awarded on a competitive' basis 
and school participation is determined according to a 
master plan and the success of individual schools in 
competing for expansion funds. As a result, the Esirly 
Childhood Education procedures would have to be separate. 
The Department v;ould also be embarrassed if two'teams 
shovjed UD at the same school. Therefore, for the pilot 
and subsequent year, the plan called for separate 
efforts. A review v;ould be made for considering con- 
solidation the fallowing year. 

\ 

This revised plan also considered the relationship 
with the Office of Program Evaluation. Althou^;h monitor 
and review functions differ substantially from evaluation 
functions, it seems likely that some confusion rright 
result in a district, especially since the delivery 
system has created many changes in the Department's 
operations. Therefore, it was necessary to define 
precisely the areas of responsibility to be assumed by 
the Monitor and Review program and the Office of Evaluation. 

■ < 
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It was also proposed that one evaluation consultant 
participate in the Consolidated Monitor and Review 
program. This person would assist in preparing proce- - 
dures and materials related to legal requirenisnts for 
planning and implementing an evaluation assessment. In 
addition, the consultant would participate as needed in 
Monitor and Review of on-site visits, adding specific 
expertise to the team and broadening its depth of experienc 

This plan was. circulated to key program personnel 
and program rftanagers who would be concerned. Recommend- 
ations and criticism were compiled and the plan was 
modified. ^!Ehe proposal .was resubmitted to Cabinet again 
on January 29> 197^. Additional modifications were - 
made due to our emerging involvement with county offices. 

A lesson was learaed from the first proposal. It 
was somewhat lengthy. and in more detail than was necessary 
at such an ecrly stage. The revised plan was presented 
as an Exeo(utive Summary, A review 'of this plan may be 
found in AppCndix'"E, "Consolidated Konltor and Review 
Services: Executive Suminary of Revised Monitor and 
Review Plan," 
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\ HHdb Executive Summary was succinct and very easy 

toifollow. The plan also served as a good connector ' 

• 1 

between "the previous Cabinet presentation and the 

I 

revised plan. 

The Executive Summary restated the philosophy and 

purpose of Consolidated Monitor gnd Review. In addition, 

cross r,eferences were always made to the original proposal. 

In' order to accomplish the purpose, the plan committed 

Itself to the following philosophy of operation, i.e., 

positive reinforcement, objectiveness and openness, and 

ft , ^ 

quick response to complaints. Thereafter, the plsn 

asked for Cabinet decisions. The request for decisions 

were as follovjs: 

1.1 Cabinet Decision ; Are these principles appro- 
priate as general guidelines for operation of 
the Monitor and Review program? The decision 
was favorable. 

2.2 Cabinet Decision : Should Monitor and Review 
hrve a goal of conducting comprehensive monitor 
and review in iSO consolidated programs? The 
decision vas positive, but somewhat inconclusive. 

2.3 Cabinet Decision : Shall 20 State Department 
consultants be redirected for Monitor and 
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Review activity during 197^-75? Cabinet 
delayed this decision until later when ,a 
* complete inventory of personnel in the Matrix 
could be made. I was responsible for conducting 
this inventory, but it was not to be made 
until much later. Nevertheless, the eventual 
later decision wa's favorable. 

The second request for Cabinet approval did not 
provide everything we- requested; however, it did provide 
a green light to prooeed with the essential elements 
included in the practlcum. We were authorized to begin 
developing the instrument and the procedures. We weife 
also authorized to conduct on-site visits in 20 districts 
to test our procedures. Thus, the first very significant 
task in executing the practicum was completed. Consoli- 
dated Monitor and Review was a new, fully authorized 
departmental effort. 
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2. Recruiting Staff for the Planning Team 

* 

One of the greatest obstacles In starting any new 
program Is v/hat I term the recruitment oi securing of' 
staff to Implement the new program. Even If the proper 
authority allows one to obtain the personnel, difficult 
ties will arise. New positions require civil service 
concurrence and budgeting approval an4 this takes con- 
siderable tlme^. In thlB prtfgram no deadlines would have 
been met If this avenue were taken. The alternative was 
borrowing or redirecting staff, and this Is the technique 
I utilized. 

In this effort -we were authorized a four-man 

planning team .and^ later, a full complement of 12 pro- 

< 

fesslonal st^ff members to Implement the 20 pilot on-site 
visits. Although the activities In this program were 
Indeed legitimately authorized by state and federal 
sources of funding, e.g.^ Senate Bill 90 (Educationally 
Disadvantaged Youth) and ESEA, Title I, securing the 
staff was another matter. The problem was further compli- 
cated by redirection that had already occurred. In 
essence, the Departraetit was critically short of personnel 
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avslXable to accomplish the existing priorities; there- 
fore, I was faced with a serious problem. I had the 
authorization, but had to encounter the difficulties 
of redirecting staff from other activities. I knew the 
tasks that had to be undertaken, but I had to */restle 
the individuals from other units with less priority. 
Moreover, knowing the tasks, 'I had to consider people 
who could undertake the kind .of work spelled out in 
the proposal. 

The first staff person made available had excellent 
skills in the area of computer technology and previous 
experience with one of the sub-unit's Individual monitor 
and review efforts. This person proved to be a valuable 
asset to the program. He initially worked with me on a 
part-time basis and after a few woeks was assigned' to 
work full time, directly under my supervision. 

The next person I recruited was also an invaluable 
asset. This individual had considerable experience in 
the area of program development of specially funded 
programs. This person was thoroughly familiar with 
working with the specially funded programs included in 
the consolidated programs and had served as a team 
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member for the first year's effort In consolidated pro- 
grams. This staff member was In demand by another xinlt 
and there was some difficulty In securing his services, 
but shortly he was assigned full time. 

We proceeded to work as a team of. three for several 
weeks, but the pressure was too Intense. Ad)31tlonal 
help was required. I decided we particularly needed 
someone who understood the programs from a strong legal 
standpoint. Numerous laws, regulations and directions 
were existent, but nobody had ever totally analyzed them 
from arf Interrelated legal standpoint. Such an analysis 
was the responsibility of this unit, and one of the 
requirements that .had to be met before building the 
actual Instrument. 

I knew a person who could do this, so I contacted 
him and persuaded him to Join the planning team. After 
a rather lengthy delay, we secured the Individual's 
services by completing a transfer and changing the source 
of funding for the position. This person was soon to 
perform a critical role. 

The planning team was now complete. I was directly 
In charge and Immediately supervised the staff. Two 
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major ob'stacles remained* We had no space allocated 
for this effort and no secretaries. Based upon past 
experiences In educational agencies, allowl*ig staff to 
remain In the old unit will not accomplish the objective. 
Since each staff mpmber already possessed space In the 
old unit there was a problem of double-spacing. 

I solved this problem by moving Into an abandoned 
section of a floor which was to be remodeled; we Just 
physically moved Into a section which had desks. Shortly 
thereafter I secured Janltoulal service and the tele- 
phones were^ connected. We had a few months reprieve 
to solve the space problem. 

Our authorization for professloiial staff Implied* 
we had secretarial help because of a set ratio; however, 
since the Individuals came from separate units, no 
secretaries were available. This was a serious problem. 
The group used my secretary for several weeks, but the 
overload for her was too great. I solved this problem 
by borrowing secret^arles from friends for short periods' 
of time. Eventually, a secretary was redirected to the 
team and the problem was alleviatedj* 
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. The staff I recruited was diverse In b^ckgrounci and 
experiences and sometimes there were differences concerning 
the approach to solving problems, I stayed very close 
to this group for a period of time. Later when we began 
to work ?s a cohesive team;" I decided to employ a leader- 
ship technique. I started to use a force-choice technique, 
I asked the group to select a coordinator during my ' • 
absences from the teah). The strongest personality emerged, 
and I selected him as a coordinator for the planning team, 
who would work directly under my supervision when I was 
a^)sent. 

' The work accomplished by the planning team was 
prolific and the quality was excellent. This task was 
completed quite satisfactorily. 
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3/ Analysis of Legal Elements of Program 

The monitor and review system I was developing 
would have to .look at as many as seven categorical 
programs In action at each site. 'I had to establish 
connections among them concerning' whether the fiinds 
were being used optimally In terms of the total activity 
at each site. Such was the purpose of developing a 
consolidated system. 

Simultaneously, I had to design an Instrument 
which was capable of examining the operational legality 
of each program. Most of the funds being used were 
categorical In nature. Each source of funds ecfianated 
from an Independent lar and set of regulations, and, 
each source of funding was directed toward a particular 
student population, e.g., economically disadvantaged, 
educationally disadvantaged. To further complicate 
the problem, each source of funding had Its own consti- 
tuency of school staff and community representatives 
which had developed over the years. Each source of 
ftmding had lobbyists. Congressional members and 
agencies which examined the funds closely in the 
Interests of the specific student population or vested 
interests. 
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California's Superintendent ^^f^ubllc Instruction 
has been determined to build a cbnsolldated delivery 
system uhlch would deliver coordinated funds to children. 
At the same time he ^cautioned staff to build a system 
that would not allow allglble, disadvantaged children 
to ^Bllp through the cracks/' His firm commitment stated: 
"As you know^ I have yery dee\) feelings 
about compensatory education^ I have shared 
your hopes for Its success and I have fought 
side by side with you to overcome the c^batacles 
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that stood In i Its way . . . I^TJlve you my word,/ 
Insofar as It la In my power, that not one 
dollar, not one dime, of funds appropriated 
for disadvantaged students will ever be 
diverted to any other puirpose."^^ 



This challenge was what motivated me to encourage 
the building of a monitoring system that would consider 
the rights of such children and legally protect our 
State Department of Education. 



^^emarks by Wilson Riles, State Superintendent of 
Public Instruction, Inservlce Conference of 
California Association ^of Compensatory Education, 
Los Angeles, March 8, 197^. 
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Being motivated to design a monitoring system nas 
easier than building one. There were many programs 
and each was similar in many ways^ but ^ulte different 
In other ways« 

Analyzing the laws separately and in terms of 
Intended usage presented a problem of conjgruence. 
Early consolidated attempts in^ Texas were unfavorably * 
viewed by the Federal Oovemment because it was perceived 
that the effort did not adequately consider balance 
between the totality and the individual parts. I.e., 
programs. 

Congruence, as I am applying it here, refers to 
successfully analyzing the attempt to achieve total 
Integration while considering the laifs and rules and 
regulations of both federal and 3tate categorical and 
general funding. How should one pr-oc^ed then? 

One of the responsibilities of the Monitor and 
Review effort, as I have stated, was to check program 
compliance with both federal and state laws and regula- 
tions. In an effort to meet this responsibility, I 
decided to attempt to illustrate congruence between 
federal and state law and our relatively new consolidated 
delivery system. 
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In order to check congruence, the planning team 
constructed a table designed to sf;xve as a quick, but 
thorough', lega\ reference system which showed relation- 
ships between program concepts and the law. This was 
a .most time consuming process because we had to gather 
all. the laws and regulations, become familiar with their 
facets, and analyze them in terms of our new delivery 



system, Ihis first new docuneijt was titled "Consolidated 



gulations" and may be found in Appendix P. 



Headings on top of the charts represej>t an attempt 
to follow major ar^ects of the newly designed consolidated 
Approval process. The major headings were as follows: 
"^Comprehensive Planning, Inservice, Maintenance of Effort, 
Parent and Community Involvement, Participation of ^ 
Children Enrolled in Non-?ublic Schools*, Evaluation, 
Reports, Records, General Provisions, Comparability, 
and Inventories, Those were not precisely the same \ 
headings used by the Regional Service Teams; they were 
logical headings for the program under which laws could 
finally be categorized. The left column reflected the 
appropriate federal regulations; the rip;ht column ^ 
provide^ the proposed State of California, ^dmlnlst3?ative 
Code, Title 5 regulations with cross-referpnced California 
Education Code sections. 
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The reader will note that the Interconnected parts 
quickly Illustrated a triangular congruence among the 
consolidated delivery system, federal, and state regula- 
tlons. The document became very popular with the staff 
members responsible for approving applications. This 
was not the Intent, but they found that they could use 
it for determining whether projects met legal require- 
ments before being approved. Some school district 
planners used It ip a similar manner. 

The document w6s essential to my planning team. 
We were able to use it as the foundation upon which we 
wouldf bul^ld our procedures and instruments. In addition. 

It was useful as a quick reference showi^ig where the 

o 

consolidated rules and regulations and the application 
were complete or incomplete for ea^ch area. 

Another very valuable achievement at this time was 

that the "Consolidated Regulation" proved that our 

A- 

consolidated delivery system was legal. The various 
interest groups and program constituents had been 
critical of the changes. However^ we now had a document 
which could l^e used to illustrate our basic departmental 
compliance '"Ith the laws^^. Numerous program managers 
and staff members also used the document for this purpose 
during negotratlons and visits to local school districts. 

s 

/ 
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4, County Office of Education Involvement 






Michael Scrlven, national lecturer In evaluation 






for Nova University posits that the by-product of an 






objective may be more Important than the objective 






Itself. III an Important way, this principle applied 






to my effoi!^ts In the practlcum. Due to a new commitment 






by the Department of Education, closer ties between 


• 




California's 58 intermediate agencies, i.e., county 






offices, were being attempted. These xanlts are, in ^ 






effect, agents of the State of California, but they 






oi>erate local levels. These county superintendents 






are locally elected. They then select a staff and ' 






provide a number of different regional servicea to 




* 


local school districts. ^ 






Recently, the California Legislature has been 






closely examining county functions. A number of 






Legislative members have been tiuite critical and have 






ber»n examining county functions in terms of efficiency. 






cost effectiveness, and redundancy between State Depart- 






ment and county services. 






^^Educatlon Evaluation: Theory and Practice, Blaln 
R. Worthen & James Sanders, Charles A. Jones 
Publishing Co., Worthlngton, Ohio, 1973, page 5^. 

X. 

. -'^ ■ 
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With this background In mind, I decided to propose 
that >ie closely Involve the county offices In our planning 
and Implementation. This idea was fortuitous for it was 
qulfckly accepted . and was even helpful In selling the 
total monitor and review proposal at the Cabinet level, 

I designed a county office Involvement that included 
a true peer relationship. It was proposed that all 
planning be Jointly developed. Including all instruments 
and procedures. This kind of intensive involvement in 
the initial stages of the program was unprecedented in 
California or any of the numerous state departments I 
have visited. 

In order to achieve this kind of intensive involve- 
menti I charted several action steps. The first step 
Included a close briefing at the Chief Deputy Superinten- 
dent level. After this step was successfully completed, 
authorization was given to contact what is known as the 
y^lx Area Chairmen," representing all of the county 

offices. This group had recently started monthly meetings 
with key administrators in the Department. A list of 
the. names of thl« group may be found in Appendix G, "Six 
Area Chairmen." 
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Hy program manager and I presented our proposal 
to this group* After a one-hour pi?esentatlon and a 
lengthy discussion, the representatives were enthu- ^ 
Biastlcally prepared to participate. . This group had 
been earnestly "peeking a close Involvement In the total 
delivery system. Although they were more Interested In 
the work of the Regional Service Team (RST) approval 
system^ they were willing to work with the monitoring 
system as an entry point. 

When approval waS given, I requested that this 
group select a planning team to' work e'losely with oie.._. 
This concept was also approved. A total of four repre- 
sentatives were selected from the following county 
offices: ' Placer County, San Diego County, Santa Cruz 
County and Stanislaus County. The individuals selected 
were of high caliber and proved to be of Invaluable 
service. Moreover, they tended to politically represent 
key individual's areas, internal groups and , organi- 
zations. If I could prove our credibility end sincerity 
with this group, the practicum would have a good chance 
of succeeding. 

I immediately contacted these individuals after the 
county superintendents had sufiioient time to notify them. 
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The Individuals were enthusiastic and prepared to work; 
however, it was obvious that they were doubtful about 
how far I intended to go in creating the peer relation- 
ship end joint approval of all instrum^ts and procedures. 

In order to demonstrate our spirit of cooperation, 
I proposed that we conduct our meetings in the individuals* 
county offices. The approach was accepted and we were 
invited to have our first meeting in the Santa Cruz County 
Office of Education. I took my planning team of four 
State staff members to Santa Cruz and united them with 
the county office members. At this time I established 
the Joint County-State Planning Team, consisting 'of eight 
Individuals. During the course of the practicum. this 
team would subsequently meet in Santa Cruz, San Diego, 
Modesto, and Sacramento. 

The team wss a unique group- of individuals from 
various backgrounds, interests, training, and points of 
view. Over a period of months I served as chairman 
^f the group and was cble to bring the group into a 
cohesive unit. The group planned together, built instru- 
ments, designed strategy^ and implemented programs as ^. 
if they were from one agency. During this period, the 
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^8 
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effort was my primary responsibility and we spent a 
considerable amount of time together In widespread 
locations* . 

The first meeting In Santa Cruz was initially vei^y 
slow moving. A con3lderable amount of time was spent In 
testing and getting t.o knovj^each ^ther. After a peirlod 
of time, we agreed upon certain principles and procedure s. 
Fundamentally, v;e agreed to the Joint effort and the building 
of a positive monitor and review system. This careful 
approach was necessary because Individual efforts of the 
past were perceived to have been somewhat negative by 
county office staff. We also agreed that unilateral 
actions would not be taken by either group. I was able 
to establish enough trust so that state staff could con- 
tinue to develop materials when we were not able to be 
together and county staff would have the opportunity 
to review such work. This was necessary because my 
planning team was assigned full time and county staff 
members were assigned part time at this point. 

At this meeting our primary product accomplishrnent 
was the preparation of a Joint presentation to all county 
superintendents who would soon be meeting in San Diego. 
This product may be examined by referring to Appendix 
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•^Consolidated Monitor and Review; Proposed County-State 
Joint Services, Emphasis on Monitor and Review." Reflecting 
our Joint efforts, this document was published by the 
Santa Cruz County Office audiovisual section. 

' In late January a Joint presentation was made to the 
county superintendents. Although the Six Area Chairmen, 
who had given approval were all county superintendents 
and represented the entire group, it was vi^al that all 
58 Independently oriented county superintendents "buy 
Into" the partnership. Earlier, I had planned in advance 
and secured a letter from the President of the Six Area 
Chairmen. This letter was developed by the county 
members of the planning team. Thus, the appeal for 
cooperation was not being broached for the first time* 

The presentation was given in a planning session 
and was well received. During this joint presentation 
the basic framework was presented. We defined the total 
delivery system for the-^e tended to be some confusion 
concerning role, function, and respooGibllity and about 
the difference between comprehensive planning^ consolidated 
approval, and m.onitor and review. We explained the Joint 
planning efforts, the Monitor and Review cools that had 
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been developed to date, county office feelings, team 
accomplishments, and the "pay-off" for county offices. 
Finally, we asked permission to use twelve county staff 
Individuals to work with twelve atate staff members for 
the pilot on-site activities. We projected a request for 
38 consultants for the following year. 

We received many questions about the plan, but 
eventually the effort was unanimously supported. It 
was -agreed that each area chalnnan would work with his 
constituents and nominate two full time equivalent posi- 
tions for the pilot team. Each chairman would also 
nominate three districts: large, small and intermediate, 
to be reviewed by the team in the pilot effort. 

After this large meeting in San Diego, the Joint 
County-State Planning Team continued to meet. The San 
Diego County Office hosted the team for an entire week. 
Secretarial, audiovisual, publishing and communication 
support were also provided. This was a very productive 
period for the practicum. Working closely togetherj» wc 
were able to build the key concepts for the instrument 
a^d procedures as well as a significant portion of the 
detailed parts of the key M-127 Instrument, 



Next the Stanislaus County Office hosted us In 
Modesto. There the harmony and detailed work continued. 
Between these meetings, additional meetings In Sacramento 
and our office work, the heart of the Instrument and 
procedures became a reality. While the planning team 
was working, the Associate Superintendent for Secondary 
Education and I continued to meet with the Six Area 
XJhalrmen on a monthly^'^^rfi^s In Sacramento and San Fran- 
cisco. We kept them Informed and they supported us and 
presented the names of county staff and districts for 
participation In th^ Pilot Monitor and Review, 

In conclusion, the decision to Include our county 
offices In the delivery system for Monitor and Review 
wa^ a fortunate one. The cooperation was positive, 
a new working relationship was created, v;e were able to 
staff our pilot effort, and a trend was established. One 
addltJ^onal outcome was that the State Department of 
Education has decided to Involve county staff In all of 
our significant activities In the future. This policy 
Is now official, V/e proved that It could be done when 
credibility Is established through cooperative and equal 
working relationships. Finally, I believe the county 
office Involvement was timely and helped sell the system^ 



'Prior to my proposal, consolidated Monitor and Review 
field activities were not planned for the 1973-7^ 
school yearo 
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5^ Development of an Instrument for the Pilot MAR 

Working directly under my leadership, nine pro- 
fessional staff members commenced work on a consolidated 
monitor and review Instrument. This team consisted of 
a coordinator reporting to me and eight other professional 
staff Four of tnese staff members were the county 
office staff members. As indicated, this was the Joint 
County-State Planning Team. 

At this time, I decided to conduct an ERIC search 
In order to determine what other work ^had been done lli 
this area. The ERIC search was non-productive, which . 
Indicated that w6 were In a new educational activity 
area.. My survey of the literature did reveal that an 
entity for consolidation existed. Under an ESEA Title V 
grant, the U,S. Office of Education funded COGRAM, Con- 
solidated Grants Management. This Is a Joint effort by 
the U.S. Office of Education and seven state educational 
, agencies to study and test the feasibility of developing 
a consolidated application to secure funds for various 
education programs* The COGRAM project had been 
fxinded by an ESEA Title V, Se<:tion 505# appropriation. 
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The project was started in the winter of 1972 and was 
last funded In April 197^ • Each state has selected Its 
own course of action and developed its own materlals.-^^ 
Work has been undertaken by these departments, but the 
accomplishments related only to the development of the 
consolidated application. I was simply unajble to, find 
B comprehensive consolidated .monitor and review system. 
It was at this point that I realized I was exploring 
new territory^ This made the task more difficult, but 
It did rnajke the practicum effort quite innovative and 
suddenly more exciting. ^ " 

Pifter several attempts and failures to reach an 
agreement, we decided upon the following modus operandi . 
We would undertake a content analysis extenfling from 
the identification of general areas through the identi- 
fication of Monitor and Review items and questions. 
Chart I reflects the basic procedure. 
Level (District-School) 
Authority 



Area- 



Topic 1 

Element 1 

Criteria (item)-^ Question 



to Whom 
Directed 



^^COGRAM, Consolidated Grants Management, U.S. Office 
of Publication, 73-266^ DE 6481 7-7^, 1,500 U.S. 
Government Printing Office. 



91 



This analysis addressed the areas and the topics within 
oach of these areas^ We next considered elements within 
each topic. We dl.vlded the MAR process into two parts. 
I.e., district level MAR and school level MAR^ Appendix 
Ij •^Monitor and Review, Comprehensive Program Element 
Identification*' illustrates the areas and topics. We 
decided upon six general areas at the district level: 

- Comprehensive Instructional Plan 

- Maintenance of Effort • 

- Parent and Community Involvement 

- Dissemination of Information 

- Evaluation 

- Fiscal and Administrative 

Pour general areas were used for the school level analysis: 

- Comprehensive Instmactional Plans 

- Maintenance of Effort 

- Parent and Community Involvement 

/ 

\ 

- Evaluation 

The Monitor and Review procedure was developed to 
^involve the examination of consolidated pi^ograms at 
both the district and school levels during program 
Implementation. The new instrument, which I titled 
M-127, to match our A-127 Consolidated Application, 



was designed to assist In this function. X was deter- 
■Ined that we should not create a new consolidated 
BWfiltor and review model divergent from th^ new consol- 
idated delivery system. We would develop a system that 
was conpatlbie wl|^ the new consolidated application 
effort. From this stslndpolht, our .monltorliig system 
would Inflect the legal requirements/ In such a way that 
It would equal the ium total of alf/of the consolidated 
rules and regulations. I did add the federal regulation 
whldi were not directly stated in the Consolidated 
Application (A-127).. 

' ^ - • , ' ■ <:i ■ 

. The points of inquiry were grouped jmder topics 
and the topicd were grouped together under the general 

V 

\ 

ax«a8 I described. This Instrument was developed in 
order to give direction to the inquiry. The questions, 
-then^ were directed to the • review staff and not to be 
responded to by the interviewee. 

/ 

f 

The instrument became imown as tht M-127 which may 
be found in Ajppendlx J, "Consolidated Program Composite 
M-127." The instruBient is best understood by refearrlng 
to the development prooedus^e. Earlierj, under legal- 
analysis, the federal and state regulations were grouped 




by conutton categories. Next, we determined the major , 
reporting areas. An analyses then occurred which moved 
from areas to topics. " 

In order to understand this movement, one must 
psruae the headings found in the M-127 instrument found 
In Appendix J. Page 4 of Appendix J has also been 
included as Chal>t II for purposes of illustrating the 
document. These headings are found in the center of 
the page directly under MAR Points of Inquiry, e.g., 
1.0 Comprehensive Program Planning; 1.1 Selection of 
School Sites, Page 4. 

Later the ana^i&sis continued from topic to element 
and these may be al^ found In the document^ e^ge^ 
column 3 and 4 on page 4» In these columns Selection 
of School Sites 1*1 is broken down Into topics and 
>eleiaents^ e.g.. Title (a) Selection^* (b) Grouping^ 
(c) Ranking. The analysis originally Included another 
refinement criteria* <!^J^e field staff were unable 
to distinguish between element and criteria^ these 

columns were eventually collapsed Into one. 

/ 

Each item we identified was used as the basis for 
a point of inquiry and the composite Instrument was 
prepared on a data sb#^ so that the authority as well 
as tho on-site source could be indicatelf* 

£8' 
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Additional features of the instrument are illustrated 

'\ .■ 

by referring to the doeument itself. There were two 

♦ * 

parts to "Authority. " The first column was keyed to 
the basic documents in the new consolidated regulations 
which were described at the top of the' page. The second 
eoluom« titled "Section," referred' to the law or 
regulation itself.' It should be notisd that all were 
correlated. > 

' . ■ ■ i ■ ■ 

The "y^s*^ or "no^yCOlAimns refer to the exltitence 
^ of one of ^ the 22 reqiidred products or compliance «j»th a 
specific law. Then the criteria became the satisfactory 
development of the 22^ as required In the regulations^ 
plus the l&yi. The coluto^ titled "Levels" refers to 
district. The mine-part column m&rked "Intervleifee#" 
referred to oup source of securing this Information. 
The sources were reflected at the* top right part of 
the document. We agreed that our on-*slte MAR teams 
would require Interaction with the following: 

- Program Director 

- Business Manager 
• Teacher 

- Aide 

r 

- Parent 
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T Principal 

, . 'is 

• Reaource Person *• , . \ 

<9 

- Application . . 

- School Plan , ' 

- Planning Prod.ucts . , * 

♦ 

■ . r' 

One example \«ill help clarify the planned usage 
the Instrument. The first page of the Instrument p^pe'r, 
refers to Area 1.0 Comprehensive Program Planning;. 
Topic 1.1 refers to the Selection of Schools Sitee and . 

* 

1.1-1 refers specifically to*^ESEA Title 1, ^K^2. indicates 
that this criteria Is specified in the "Instznictions for ^ 
Comprehensive Program Planning. " Under "Section, " .it 
is evident, that Federal Regulations, ,116.17 (c),- (h) and 
(f ) and California Admlnis:tr8tlve Code^ Title 3, Section 
3934 (a) and (d) both have requirements. When one 
revere to thes/^ws. It Is clear that there are 
specific criteria related to (a) selection^ (b) grouping^ ' 
'and (c) ranl^lng. We then connected these criteria to 
slpeclflc questions found In the center column^ e«g«^' 
(a) source data collected^ (b) source data us^ed for 
groulxlng schools^ etc« Finally ne ifiould determine the 
answers by talking to the Program Director and examining 
the. Planning Products. 
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.The process seems sueclnctrto one not familiar 
• - ). , • - V 

with the rules and regulations, laws and planning proce- 

. •' , . ■ , 

dures. ' Howeyer, even, thl* succinct encapsulation of 
the entire process Is lengthy. It was obvious that 
ex^nslye Inservlce' i(ould_be necessary to enable a 
field con:|ultant to use this' Instrument » and training 
would be necessary In the. planning process. Staff 
.ifould also have to be tralhed In Interview techniques 
and analyzing the required pi^oducts, e.g., needs ^ 
aissessment. 

/ ■ 

/ A draft of this document was sent to all interested 
pro^rainjidna^ers ^and consul^'tants working dn the regional 
Xfip^"-^ ^ it^eir consnents were solicited and modifications 
were made based upon their input. At this turning 
pointy the' banc instrument was ready. Later this 
Instrument could merely be subdivided according to 
areas and dlrectl^y used by consul tahts working on the 
future on-site review teams. 
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6. Establishikont of Complete MAH Procedures 

with the legal analysis completed and the p^lt^^^y 
Instrument M-127 completed, the next major task was 
the development of the complete Monitor and Review pro- 
cedures. The complete procedures are somewhat analogous 
tp the management plans recently used In some businesses^ 
The steps Involved were complex and had to be systematized 
In order to avoid confusion and duplication of effort. 

I shall not attempt to describe every minute proce- 
dure that was developed; howcver-^ Appendix "Il^nltor 
and Review Implementation Design, Schedule of Events* is 
helpful in Illustrating the sequence of events. Part B 
on the second page illustrates some of the management ' 
considerations. My ^|4^st step was to develop the 
materials necessary* for completing the Monitor and 
Review Procedure Plan. These steps first included 
developing a scheduling procedure. In order to do " 
this we developed regional statistics reflecting the 
size of the project, a scheduling procedure and a Master 
Monitor and Review Control Chart' which would be used * 
Internally to plot our daily progress. I also (Redded 
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that we could systematize the operation by preparing 

• . *> 

pre-and post-letters to the district In advance of the 
review. District summary data sheets would be prepared 
so that consu?tants could qulckij^y become familiar with 
the .main Ingredients of a local program. The Monitor 
and Review report. form also had to be developed because 
It would later bec6me the basis of our official report. ^ 
An on-site guide would complete the basic Monitor and 
Review Procedures. 

The best way to describe the Monitor and Review 
Procedur'fes Is to make reference to Appendix L, 'Monitor 
and Review Flow Chart."- There were five sequential 
steps: 1.0 Pre-planning; 2.0 On-Slte Visit; 3*0 Exit 
Interview; 4.0 Final Monitor and Review Report. These 
steps flow from left to right on the top of the flow 
chart. Under each step moving downward, may be found 
some events that would occur. 

Under '*Pre -Planning," the first event was the^prepared 
letter which was sent to the district superintendent and 
the project director. The purpose of thxs action was - 
to coordinate the Monitor and Review visit. The letter 
indicated the dates for the possible Monitor and Review 
Visit and district concurrence with that date. 
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• Event 1.2 called for arranging Interviews with the 
Consolidated Program Director In the district. The , 
Monitor and Review Coordinator, working with the P.rogram 
Director- scheduled Interviews for Individual Monitor 
end Review team members with program personnel within 
the district. Past, experience had taught me that' this 
kind, of scheduling was vital. Parents cannot be avail- 
able at just any time. Teachers • classes must be 
covered, substitutes must be requested and the admini- 
strators must carry on their responsibilities. Coiifuslon 
and bad feelings were reduced by using this teen- ♦ 
nlqUe. 

Event 1.3 called for the preparation of materials 
for consultants and county office staff. These materials 
Included: 

- Material check list (Form M-3) ^ 

- Assignment Sheet (Form M-^) 

-M-127 , ^ 

Report form and instruction sheet (Form M-2) 

- On-site guide reference (Monitor and Review 
Reference #4) 

- District summary sheet (Form M-l) 
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The purpose .of these materials was to provide a system- 

atib, orderly method of reviewing the projects. 
« 

• In step 1.4 the Monitor and Review Team Captains 
t<ould review the purpose of the visit with the t^eam. 
The Monl?or and Reylew Administrator would brief the 
team leader concerning the nature of the visit and the 
dlstribjitlon of materials. 

Completion of these |vents moved the proceduf^s 
to the On-site Visit (2.0). Event 2 



.1 Involved an 
oneernlng the visit. 



orientation for the district staff ^ 
The Monitor and Review Team met as^'a gi%up with the 
district staff so that district personnel could become 
(Srlented to the Monitor and Review system. In turn, the 
review team members used this opportunity to familiarize • 
themselves with the consolidated program offered in the 
district.. 

This kind of meeting was also helpful in alleviating 
district concerns about the' nature and purpose of the 
'Visits. This procedure allowed the different staff 
members to interact prior to conducting the visit. 

Interviews, in event 2,2 were conducted with admini- 
strators, fiscal personnel, teacher aides, community 
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representatives and students. Classrooms were also 
observe^. This event, was, of course,' the heart of 
the on-site review. The kinds of quest Ion sv^sked during 
the Interviews are refle- ted In M-127, the key Instru- 
ment which was previously explained. This Instrument 
may be viewed by referring to Appendix J, M-127. 
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At the end of each day the Moni|.tor and Review team 
met as a group {2,3) In order to summarize the findings, 
nils visit was helpful In clarifying what had been seen 
by. the various staff members. During this meeting a 
total picture emerged which tended to smooth -^ut rough 
edges and distortions by Individual team members. These 
meetings tended to highlight team differences. However, 
they also resulted In an eventual consensus which avoided 
totall^ erroneous reporting. 

\ . . . 

Event (2.4) consisted of preparing a report reflecting 
the findings of the entire Monitor and Review Team. This 
report was to be preparec^ the evening before reporting 
to the district. The evening session was designed to 
achieve basic consensus. 
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The next step in the flow of events was the Exit 
Report (3.0). Based upon some bad experience's I had " 
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0a:fller-'-le88 ambitious monitoring efforts— •! decided 
m had to have an exit presentation (3.1) of the report 
to the district staff. This report was read to the 
district staff as an exit presentation on the last day 
of the visit, Ther«t were two good reasons for including 
this event. First, staff are less reluctant to be overly 
critical if they have to relate the findings directly 
to the district. Secondly, the district has a chance 
to^react and tends to be less .critical of the final 
reip^t^ i.e., the roxigh edges of perception are smoother. 

The final ^vent in this sequence ^ss the opportimity 
for the district staff to make input (3.2) into the 
reporte Here itas the opportunity ^o negotiate iflth our 
staffs If deslredv I Insisted that our staff j^t Include* 
, In the final report any items not mentioned in^ the exit 
report. ^us# the opportunity to co^yer ^eryttjing came ^ 
forth here* Sooietinie^ {there van dlsagreesaeAt^ buts^there \ 
was usually a strong degree of 'q|pncurrence« Thus^ there 
Here, few surprises and no -challenges to our v final report.' 

Th^ final" two steps l!h' the Monitor and ReView Pro-- . 
cedureS'floH of events are the FJLnal Monitor and Review 
Report tKO) ;a^<? Rep6rt- Distribution (5oO)* These \ 
'steps should be desf^ib^d concurrently because they are 
^ cldsely intemlatede 
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Preparat^.on of , the final report was a^ complex pro- 
cedure In terms of worlc. -involved and cJ^earance within 
the Department. The Monitor and Review Team Captain 
was responsible for preparing the report, based from 
evidence submitted h Ira by the tot^l Monitor and 
lie view Team. then submitted t^e* report to the 
?!onltor and- Review Administrator. This procedura usually 
required several transactions f or "clarity and-* accuracy. 
Draft reports were the'n sent to key departmental adminis- 
trators for their reactions and recommendations. 

The wa/ I establlcshed the system, the final signa- 
ture for any official report became that of^my managej^ 
the Associate Superintendent for Secondary Education. 
I read and analyzed each report thoroughly and recommended 
that it be approved or disapproved. It was clear from 
the beginning that as we grew into a "larger operating 
unit, our small policy setting staff ' would Jibt be able 
to Implement on a dally basis. ..Our i^^sitiglice would have 
to be maintained through alternate res^dnslbility as 
— represented in the signature blt^cic; * 



The final report then became a document from our 
unit to the superintendent of the local school district^ 



ERLC . 4 109 : 



Copies were also subill^tted to the district projoct ^ 
dM*ector, We serit copies to the county superintendents 
because of our close >rorklhg« relationships; this was a 
totally Innovative approach* Other copies wc-re sent to 
concerned administrators within the State Department of 
^ucatlon« i 



' ' ^ . : j,io 



/ 

/ 



106 

r ■ • 



7« Selection of iStsite Departnent of Sducatlon 
Steff for Pilot MAR 

Starting any nei» progx^u irlthln a large agency Is 
a oost difficult process. Although the excitement of 
starting new efforts is stimulating, there are many 
iB^ediments t^ich work against change > even when it is 
desired by the organization. Two of the lao^t serious 
obstacles are seciurlng staff and space to locate the 
staff. 

Obtaining new staff almost prevented me from 
succeeding in my efforts to implement xsi$ Maxl I Fraeticum 
when I was working in Washington, D.C. The shortage of 
staff was tio serious there that the pz>ogram was constantly 
in Jeopardy during the Initial stages. My efforts to 
secure staff assistance in this California practicum 
effort were not quite as difficult, but they were certainly, 
once again, one of the most difficult obstacles. 

Vhen the proposal was approved, I had a team of 
three professional staff members and two seciretaries. 
This team was expanded by four when the county staff 
members Joined the effort. Three state staff members 
were quickly recruited by me andf assigned with some 
problems I have already indicated. The most serious 
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problem for this t^am was securing space. I was firmly 
committed to the principle that ad hocracy is more pro* 
ductlve when the staff can work together In one physical t 
location. Since these staff members wAre already 
assigned desks in other units* it was difficult to alio- 

« 

cate double space • The pragmatic solution to this * 
problem mas to move into t^porary quarters and proceed 
lit 5plte of the problem. ^'--^^ — ^ ^ 

J 

As the program grew^ I began to look forward to the 
Pilot Monitor and Hevlevr. No longer were we ia planning 
team« Ve had to become an operational unlt« Consequently, 
I had to face the task of finding personnel In order to 
implement the practlcum« I' had determined that the 
workload wotild require fourteen professional staff and 
six secretaries. We would' hjave two teams and a complaint 
procedures unit which would fimctlon from -February through 
June. During ^July through October we would work on 
promlsihg educational practices and \nodiflcatlon of the 
instrument.^ - ^ - ^ 

^Since we did not have the staff .members under my 
progt*am manager* s contrail we ^would have to jiegotiate 
with othec units in order to redirect staff to this , \ 
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priority effort. As a general principle, individual 
program managers are inwardly vezy opposed to such an 
.arrangementi The concept of ad hocracy is sound in 
theory, but the pill is bitter when these separate 
managers are confronted with either a permanent or 
temporary loss of staff. 

. ^ My efforts were first directed toward staff members 

^who were in an' exl^sting review unit in another activity 

8upport^anrt». There was excellent support here and the 

individual staff members were anxious to work in the new 

unit. Thus, tbree new members were rather quickly* added 
I 

and c6ntributed .to the rapidly accelerating- workload 
being generated in anticipation of the pilot on-site 
visits. 

I 

An additional staff xoember >fa8 also added rather 
rapWly. 1 was aware that an ci^lstlng program would • 
soon be terrafj^ted^ the State Legislature so I approached 
this very well qualified staff member who fortunately, 
was willing to move Immediately* Thez^e were now six 
professional staff members worlclng under my supervision* 

The remaining series of negotiations wejre^not as 
productive and Indeed very painful* I had to Ifiteract 
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ulth ten different program managers In the attempt to 
secure the remaining consultants. Deliberations ifere 
time consuming and confusing. Excuses were made, alter- 
nate proposals were given, and all efforts were futile. 

In desperation we submitted *a memorandum of agree- 
ments and ^aagreements concerning each staff member 
being considered for inclusion in the program. The/ 
person's na^e, unit, and manager were included. A 
summary of tl^ progress was also included. ^ This memo- 
randum precipitated high level negotiations. As a 
result of this procedure, five professional and two 
secretarial staff members finally were assigned to the 
• program. I considered this situation a success. We 
now had 13 staff members. ' • 

One significant addition remained. Since my pro- 
gram manager had decided that he wanted me, by tKlT time, > 
to design the project, get it started, and then remain 
working directly with him as an administrator in the 
Secondary/Adult Age Span, the proposal called for a 
Monitor and Review Administrator iiho >«ould be responsible 
ror field implementation. I would continue to be closely 
involved by working with the staff, controlling policy 
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and clearing documents --afld procedures. All major Instru- 
nent^ policies and documents would require sign off 
from our office « 



i 



The original plan called for this administrator of 
the Compensatory Educatlonj Activity Support Unit, to 
serve as the Monitor and Review Administrator. Due to 
this person's already heavy workloadi this plan did not 
materialize. We therefore searched for a replacement, * 
and another administrator was selected who would report 
directly to our unit. Unfortunately, he could not assume 
the duties Immediately, so I continued to directly super* 
vise the staff and perst^ally carried the project through 
the Joint Inservlce training. 

The new Monitor and Review Administrator remained 
with the program and directly supervised the pilot Mpnitor 
and Review and implemented the plan exactly as designed. 

This person performed wiell, but was replaced on July 1 

\ 

hy a second individual who as^Umed the responsibility 
for the next fiscal year's effort, \ 

Al through there were difficulties, I was successful 
In securing the staff required to Implement the pilot 
effort. The program was able to move from the planning 
to the operational stage. 
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8, Recruitment of County Office qf Educatloh Staff 
for the Pilot Effort 

0 

Fundamental to the design of this progran« was 
the involvement of county staff In the entire process. t 
As I described earlier » the county representatives 
partiolpated li. plaxinlng the design of the Instruments 
and procedures. Participation was cooperative nearly 
from the beginning.^ Since the county offices of educa- 
tion were Involved In btillding the program, staff In 
these offices equally Identified with the effort. 

The planning team,^ for which I served as chairman, 
decided to support me In my desire to utilize county 
staff in the field implementation. The Resign in the 
original proposal called for two county staff members 
per team. These staff members would participate in the 
Pilot Monitor and Review as equal members of the team. 

Each team would have five to six state and two 
county st^ff members assigned. Although, this represen- 
•tlation was\not proportional, we agreed that the next 
> year's effort would be distributed more evenly. We / 
raalized tha^ most county staff could not participate 
during the entli^ five months of on-site visits between 

7 I 
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February 197^ and June 197^. Therefore, we decided to 
accept candidates on a x^>tatlon;>l basis. 

7 

I requested each pf the Six Area Chairmen to 
nominate three county representatives. I made this 
request^to the Six A3?ea Chairmen during their San 
Pranclsco meeting. They readily agreed to support the 
request. 

Each of the Six' Area Chairmen contacted county 
superintendents within the appropriate regions. Requests 
were made by telephone and through a large number of 
regional meetings. During this time, I also traveled ^ 
to individual county offices pnd regional meetings 
requesting staff assistance. ^ 

The output of this effort was l8 new county staff 
neoibers who^ere assigned to i^ork on the Pilot Monitor 
and Revletn* In addition^ the four members of the planning 
team agreed to participate « We Immediately began contacting 
the Individuals assigned to Pilot Monitor and Revlei^ 
Teams by the county superintendents* 

During this tlme^ a very fox^unate event occurred* 
One of the superintendents who served as an Area Chairman 
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decided to make a very substantive eonumtment to the 
' program. He decided to assign one of his professional 
staff members, who served on the planning teate, full 
ttime. This staff member served full time, between 
February and July, and her Intellectual and human rela- 
tion skills were absolutely superior. She made the 
single most important contribution . in keeping the stap, 
from two separate agencies, working together. As dlaagree- 
nents naturally occurred, she personally applied her 
expertise and skills In resolving differences. Thl» 
individual was a team builder In the finest sense.' Prom 
iHSr perspective It Is clear that she kept the teams together 
and was the catalytic agent which brought the two agencies 
into such a close working relationship. This full time 
assignmerit was a by-product that I did not anticipate, 
but it was cVrtalnly a fortunate circumstance. 

We were now ready to begin. We had 9 state staff 
and 22 coianty staff ready to participate in the Pilot 
\ Monitor and Review. With the exception of the Monitor 
atd Review Administrator, staff recruitment was complete 
at this time. 
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9. Joint MAR Inservice Training 

When I had the required number of state staff and 
county staff ready ^.to participate, the next major accom- 
plishment would be successful Inservice training. The 
Ik 

new Instrument was a complex one, the procedures/ we re 
intricate and the sensitivity of monltorln^necessltated 
a well-trained staff. 

I decided to plan the Inservice as a Joint effort 
with the county offices. I also made a major decision 
to have the Inservice begin In Sacramento for prellml- 
nary sessions and to ask the most supportive county 
office, which was 90 miles away, to serve as host , for 
the remainder of the week. 

I also devised another Important strategy. In 

order to alleviate concerns of the Regional Service 

♦ 

Teams who approved the programs we would monitor, I 
decided to ask key staff members in those units to 
actually teach most of the detailed classes by using 
our Instruments. 

I decided to begin the program in Sacramento for 
two reasons. Sacramento has easy access and we would 
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also have the opportunity to Invite key State Department 
officials to participate. The Inservlce actually 
started on March 12, 1974. Fortunately, we were able 
to have the Superintendent of Public Instruction, Dr. 
Wilson Riles, available to greet the entire state and ' 
county staff. He gave an excellent speech supporting 
the effort and ctresslns our new, ernsrsing partnership 
with county offices. Additional speakers included 
ray program manager, his manager, the coordinator of the 
Regional Service Teams, the Assistant Superintendent for 
Compensatory Education and myself. The agenda may be 
examined by referring to Appendix M, "Monitor and R6vlew 
Inservlce," State Department of Education, California 
County Schools, March 12-15, 197^. Indicative of the 
Joint effort, was the fact that the agenda was published 
by the Santa Cruz County Office, 

We convened for a luncheon meeting in Sacramento, 
then the entire operation moved to Modesto, Calif oml a, 
where we were sponsored by the Stanislaus County Office, 
Activities there began with a get acquainted- small group 
dinner. 

The heart of the actual training began on March 13 
In Modesto. The key county representative from the 
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Stanislaus County Office who %«as assigned full time 
welcomed the group, ^ 

I opened the inservlce Instruction per se during a 
general session for all 4? state and county staff. I 
carefully explained our purpose, the Monitor and Review 
mission and the detailed aspects of our procedures* 

Immediately after my presentation, we moved into 
an Information falre concept* It was the planning team^s 
strong desire to move away from the traditional lecture 
approach* The group was divided Into five teams: Green, 
Orange, Red, Yellow, Black* Each team was led by a 
state or county staff member who had been a part of the 
planning team* Ihls group would stay together and move 
from station to station* The system was somewhat analo* 
gous to the cluster approach used in individually guided 
instructional programs* 

During the first day^ there were five instructors 
from Regional Service Teams who covered the following 
topics: • 

1* Fiscal and Administration 

-2* Selection of School Sites and Selection of Pupils 
3* Program Goal Statements 
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4. Ifeeds Assessment 

5. Restructiu:»liig of Comprehensive Programs 

Each area constituted the embellishment and rationale 
heededvto iu)(fe(*stami key questions staff would ask during 
the on-site visits. Each area referred directly to 
specific parts of the M-127 (Monitor and Review Instru- 
\ nent) and was correlated directly to the existing console 
Idated rules and regulations and the application. 

Every ^5 minutes a section was concluded and the groups 
rotated In a set pattern. Thus each^group received ail 
Instructions In all. five areas, 

The same .procedure was repeated on the third day. 
The following topics were covered: 

1, Individualized Instruction * 

2, Parent and Coramxanlty Involvement 

3# Dissemination of Information and Evaluation 

4, Isolation and Segregation 

5, Non-Pabllc School Participation 

By the end of the third day^ the necessary components 
were covered. Then we proceeded to training In communis 
cations and discussions of group effectiveness. This 
training also covered the final day. 
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The final day closed with an announcement" of the 
districts we would visit. I had prepared a list of 
districts arid gave county staff an opportunity to sigh 
up for a time and location of their choice. 

The inservice was evaluated by the participants; 
the results were explained in the evaluatl<^ectlon. 
The results of the inservice training were very positive. 
Staff absorbed a heavy schedule .ane^seemed to be prepared 
to function in the school's* 
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10. On-site MAR Reviews 

* 

Mow that the Instruioents and the proceduz>es were 
developed and the staff oembers were trained, we were 
prepared to conduct the on-site reviews. I have terme^ ' 
this a pilot effort. However, the number of districts 
to be visited in the pilot Consolidated NonitX>r and 
Be view effort was more extensive than the average 
nuBBber of separate formal reviews cod^cted during 
the past four years • 

I had selected the two captains to lead the teams 
and recomnended the Monitor and Review adnilnlstrator 
to nqr program' manager* Ve were ready to conduct our 
on-site monitor and review program* ^ 

Ve decided to have two teams. Team A wduld serve 

Northern California. Team B would serve Southern 

«i ■ 

California. Both teams started their, reviews on the 
same day, March 18, 1974. Appendix A, "Programs Reviewed 
During Pilot Review," reflects the actual programs which 
were visited. ' 

Qsr this time we also had determined which county 
personnel would participate in each visit. Letters were 
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sent to each county staff member confirming that person's 
responsibility. We also notified the persons about travel 
arrangements and accommodations* Materials and a packet 
of Information were also sent. 

All staff, stiate and county, received a Monitor and 
Review Consultant Handbook . This Handbook Included our 

goal statement, the Monitor and Review Procedure Plan, 

» 

Observations and Reporting Area Grouping, ancj the Reporting 
Format. We also provided a schedule of visits which 
lilclud^ the Regional Data Sheet, Regional Grouping, the 
M-127»and schedule forms for the visit] Each consultant. 
It was anticipated, would have the materials which, tte 
team captain deemed Important for a particular ylslt. 

We d^lded to- u«e one staff member to ^ove In ad- 
vance of the ,team and make necessary travel arrangerronts. 
This person was prlinarlly; responsible for meeting with 
the districts and preparing a schedule for each unit/ 
This schedttie would eliminate wasted effprt and would 
be' tailored to the individual district. The responsibility 
included an hour- by-hour, day* by-day, schedule for each 
consultant. The schedule Inclii^ed classroom observations, 
interview times, places, and required materials. This 
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Information was placed In a document known as^n-Site 
Data Sheet for Monitor and Review Consultant" and may be 
examined In Appendix 0* - ; 

' TJils data sheet provided the baslo descriptive 
Information such as the name of the district, the super- 
intendent, the address, critical dates and the project 
number* Target s^iools^and the areas to be visited were 
listed. The c;ocur.:cnt 'also indicated who Kould be^ 
interviewed and In what area. On page 2, an hour-by^hour ' 
schedule provided clear directions concerning who should 
contact whom, and for what purpose and where* 

W'The Monitor and Review Observation and Reporting ^ ' 
Area Grouping," found in Appendix P, represented a c?ontro- 
versial deployment decision. This' format prescribed the 
areas, ransing from r*0-7.0, the level (district or 

\ 

school) and the personnel requ4tfemento« Cross references 
were also made to the Monluor and Review Instrument {M-127). 

This procedure was predicated on the assumption 
that one person would handle an entir^^rea, e.g., 3«0 
Parent and Community Involvement. That person would 
move from school to school if necessary. Several of the 
staff members were opposed to this schedule bicause it 
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was too complex and required too much movement. Even- 
tually I backed a staff member who strongly Justified 
the procedure ♦ 

The arrangement worked quite well for the small , 

districts, but It fell apart In the larger ones. We 

.< 

quickly rearranged our plans and kept consultants 
In one location whenever possible. I?5r decision 
to adopt this procedure was in error, so I quickly 
made the modifiqation. 

Conducting the on-site visits was a task that moved 
very smoothly. The teams proceeded to the^ field at the 
beginning of each week and remained on-site for two or 
three days. State staff was Joined' by district s^ff 
at the school site. Each Friday we conducted a review 
bf the procedures, made corrections in the system, pre- 
pared reports and made plans for the next visit. ^ 

Because of district requests.^e were forced to 
cancel four scheduled reviews. Since each district, 
had been nominated by our county ofMces, we decided 
to honor the requests by not visiting them. Thus, 
theso eler.ent?ry schoo? districts vcrc not visited : 
NorCh. Red Bluff end Eurolca; end touth. Goleta and 

_::! > - 
Santa Barbara. ^ • . . 
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One additional district was added due to a special 
request from within the' Department. We added Uklah 
because of a number of special problems there resulting 
from community problems. and concerns by the State Depart- 
ment and tjie U.S. Office of Education, We were unable 
to add alternate districts for the remaining three * 
cancellations. Therefore, we conducted a total of 17 
program reviews In 74 school sites, 
t. " 

believe the on-site reviews went smoothly because 
of the detailed attention to procedures, the structured 
questions, and the Intensive inservice training. I 
also had planned a sequential schedule that moved from 
a small, one-school district to the more complex- multl- 
pie school district. 



128 



reports The letter explained our authority, our 
responsibility and' the purpose pf the visit. . The letter 
also made reference to the Regional Service Team leader 
who could be contacted for follow-up assistance. It was 
my belief that the Monitor and Review Team would* be 
moving too quickly to pr;ovlde cjetalled follow-up 
technical assistance. ' 

"The Monitor and Review Report/ found In Appendix 
0, was designed In a prepared format that facilitated 
completion.' The top of* the first page allowed space 
for filling In descriptive data/ All of the county and 
state staff were listed, as well as the categories of 
people Interviewed. The Introduction was standardized 
'and appllqable to each district. 

The second pa£:<^ was devoted strictly to commendations 
Here, In order to create as positive a plan as possible, 
the team was encouraged to provide a narrative of all 
of those events or findings^ that were deserving of 
special praise. 

The remaining portions of the report were designed 
to totally correspond with the M-127 (Monitor and Review 
Instrument ]r used by the .consultants. Aa outline of the 

u 
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composite (M-127) was Included In the report for the 
convenience of the reader In gaining an understanding 
of the Qomprehenslve program review. In addition, the 
district was' provided a copy of the composite monitor 
and review Polht.s of Inquiry (M-127) during the prelimi- 
nary planning for the visit. This Instrument contained 
the basic criteria on v.hich the report vas based, 

iPThe Monitor and Review Team, composed of state and 
county staff, conducted the on^j^Site visit. The Monitor 
and Review Team's, detailed analysis of the district's 
consolidated program was reviewed and summarized by 
the team as a unit. In the Interest of brevity, this 
report constituted an exception instruments If there 
was no specific notation, the district program was 
found to be in compliance. Items found not to be in 
compliance were noted on page ^3 and discussed on the 
following pages. 

An examination of- one district's report will be 
helpful in illustrating the system. The district's 
name has been removed and designated as*!Dlstrlct X" 
in Appendix 0. An examination of page 3 reveals that 
^the' content outline corresponds to the basic instmiment 
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(M-127) used by consultants. This district had the 
following compliance discrepancies: 

1.8 Identification of Resourced 

1.9 Individualization of Instruction 

3»0 Parent and Community Involvement • 
^4.0 Dissemination of Information 
5»0 Evaluation 
6.0 Fiscal 
6.H -Wa^er Procedure 

6.5 Continuity of Funding 

6.6 Inventories 

7.0 (Program Management Systems 

Subsequent pages refer directly to these discrep- 
ancies as noted on page 4. The reporting area was 
Indlcajbed; the second column stated that compliance 
could not be clearly established. The last column 
then contained our recommendations or requirements. 

The final reporting system wo??ked quite well. I 
had decided earlier that reports should be distributed 
within one month of the on-site review. In some cases 
we were a few days late because some of the reports 
had to be rewritten several times. However, In general 
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the systematic procedure worked very smoothly. Since 
districts had had an opportunity to discuss some of the 
discrepancies during the exit Interview, there were no 
substantive protests or complaints against our review?. 
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12. Development of a Modj^fled MAR Instrument 

• The pilot effort was successful and had a consider-^ 
able Impact upon local districts and the State Department 
of Education. The State Department made a decision to 
■ake the Consolidated Monitor and Review Unit permanent 
withiii the Department for the 197^-75 school year. 
Based upon our experiences in the pilot effort, a 
modified instrument was to be developed for the larger 
effort. • 

During a period extending from November 1973 to 
July 197^* I was able to work almost full tine on this 
effort. After that time I was only able to work part^ 
time. ^ this time my pzvgram manager was slifficiently 
pleased with my woxk— 'he decided to keep me On his 
staff and expand my areas of responsibility. For career 
reai9ons^ I decided to accept the change « An understanding 
was reached that I nould continue to he involved because 
of my practlcum Interests. Therefore^ I still had the 

r 

I 

opportunity to work on Monitor and Revlevf^ but ny time 
was lisilted. As contrasted from my earlier direct 
control, I moved to general strategy and review respon- 
sibilities. 
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As a result of my new assignments, elements of the^ 
modified Instruments reflect some new dimensions and 
procedures. By this time the new Consolidated Monitor 
and Review System had begun to have a considerable 
effect u{)on other units within the Department, as well 
as local district A large number of other leaders 
and staff members became involved in developing the modi- 

/ 

fled Instruments and the delivery system for the next 
^ year* Some of these modifications were an Improvement 
while others caused unanticipated difficult les« None 
of the changes altered the basic objective of the prac- 

tlcum. / 

f . , ? 

The modified instrument may be found In Appendix 
Q. A summary of the differences from the Pilot Monitor 
and Review Instrument $4-12?) Illustrate the modifications. 
The most fundmental change was the addition of a quality 
rating scale. The new instrument also div±ded the 
pilot compliance section site school level and district 
level sections. The new Instrument added bllingu^ 
points of inquiry, 'and the entlrc^ddcument was published 
In Spanish as well as English. For the ensuing year 
197^1-75, a decision was made to title the new unit 
Consolidated Program Review and Improvement and the 
Instruments were renamed to reflect this change. 
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The new name for the next year's effort was designed 
to Imply broader responsibilities aryl to reflect a more 
positive Image. The title called for a quality assess- 
ment of programs, assistance with program Improvement, 
possible replication of promising practices and the 
development of written materials which would Identify 
and disseminate successful practices and programs. 

With the exceptlion of the quality rating Instru- 
ment, the de facto fxanctlons remained basically unchanged. 
Teams are still performing the monitor. and review 
functions In a similar manner. As with the pilot effort, 
promising practices and replication of successful prac- 
tlces did not materialize r-Just as with Gertrude Steins* 
rose, monitor and review remains the primary operational 
function. 

The quality rating scal6 represents a substantial 
change In the modified document. The quality rating 
•scale represents a scale ranging from Staff con- 

ducting the monitor and review effort actually rate 
schools in specific areas and add these points for an 
aggregate school rating. 
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Qhllktt most other parts of this practlcun, this one 
aspect of the plan was not part of ny oonceptuaiiziid 
solution. 

This new tool represents the wox^ of three units 
and a very large number of professional staff. The 
criteria are derived from three sources. First, the 
Pilot Monitor and Review Criteria was used. Second* the 
Early Childhood Education Rating Scale was used. This 
document represents the work of 150 professionals who 
were called together hy the Superintendent of Public 
Instruction in 1972 and 1973. . Finally the National 
Right to Read Assessment Scale, which I helped develop 
while I was in the U.S. Office of Education, provided a 
subetantlal part of the Input. 

The quality rating scale was added because California 
law required one nf the programs (Senate Bill 90 for 
Educationally Disadvantaged Youth) to be assessed by 
the Department. Section 6499.234-'-' seemed to require 
that the Department reduce funding for ineffective ^ 
programs beginning with the 1974-75 school year. 

19Senate Bill 90, Chapter 1406, Section 6499.234. 

t 

# 
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The Legislative Analyst •s Office, at ♦'his time 
was taking a strong position for aecduntsblllty. Leader- 
ship ulthln the Department responded to this direction . 
and decided that the way to achieve strong accounta- 
bility was to add a quality rating scale; 

An examination ' of the school level and ^istrlct 
level points of inquiry In the compliance section 
reveals no substantive ch^es from the original Mr 127 
In Appendix J. The same points and questions were 
merely placed In slightly different format. The 
Introduction of bilingual points of inquiry represents 
the only significant modifications. 

Some of the modifications In the new ' instrument 
were based upon Input from local district and coamunlty 
representatives. The modified Instrument was wl(]|ely 
circulated throughout the State. The Department conducted 
meetings In theT slx^^gloiy of the State and communicated 
with hundreds of people In an attempt to secure field 
Input for an instrument which would affect their programs. 

The new procedures call for an expanded version of 
the pi lot effort. The number of teams has been expanded 
from two to six regional teams. There are now 13 professional 
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and 3 secretarial state staff working In the new unit, 
and 87 county staff. Between October and Februaxy 
the teans review local school and district offices. . 
Reports are given and Improveaents suggested. From 
Mai^h 1973 to June 19?^ the teams will revisit those 
districts thit are not in compliance with ^ a very 
extensive team v:'slt. 

The 'modified Instrument was approved by the Call- 
Tomia State Board of EducatiQ|^ in September 197' 
Moreover, the new unit is operational and is actually 
monitoring and reviewing prog^QS throughout California. 
The* teams are scheduled to review .414 schools in 71 

I * 

districts. 
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III. VHAT I LEARNED ' 

The paramount learning experience for me in this 
praetlcum %fas a clear understanding that one can 
actually make an educational change happen carefully 
establishing one's goals and then exercising sheer 
detemlnatlon. When I started to develop the monitor 
and rfeview system I was told that it wa? impossible and 



that I was more than a year ^^headlVT any potential 
action in this area. Nearly everyone had a different 
response, but the recurring theme was a constant one 
of reasons why the objective could not be oompleted«. 

This theme intimidated me in the beginning and ' 
almost made me decide to attempt a less ambitious ^ 
educational change for the practicum« However, my 
program manager was sympathetic and encouraged by my 
{)|roposal« As a result, I decided to accept the offer 
from Nova University that a praetlcum did not have to 
completely succeed for the effort to be successful. 

J with odds against me and a task force of one, I 
decided to establish my objective and was determined 
to develop a real system of accountability In California's 
specially funded programs. Since this praetlcum, I have 



ERIC 



139 



135 



practiced this determination in other- efforts. I have 

found that people will object and say "no" .to proposal^;. . 

/ 

However, if the Idea is basically sotuid, the educational 
change can be Implemented. t/ * 

t 

This learning experience seeds to coincide with 
Nova's Intent to create change ^^gent abilities In Its 

participants. Change, I have/ found, generally falls to 

/ 

occur only when there Is no effort to Implement new 
ldeas« This level of confidence Has hegun to be helpful 
In my professional career, and I have already applied 
the process to other areas* 

s * , 

As X Implemented this practlcum I learned, out of 
necessity, how to Implement change through other people « 
Regardless of one^s ranK In a large system, there are 
decision makers above hlm« If one wants to begin % 
^ ^ new program he must rely on other people 5nd learn how 

to use their positions, and capabilities In fulfilling 

> 

' the objective. 

One must learn to subdue his ego at times in order 
to exercise change in the name of- others* For example, 
if the change is fundamental, the higher the rank of 
the individuals supporting that change, the better chance 
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of success. Thus, it is ego sstlsfyljig* but sometimes 
inappropriate, to place one's own name on -certain docu- 
ments when another name night provide greater influence. 

' Changes may also be exercised by workipg throxigh • 
subordinates. If talent exists in subordinates, fsilure 
to utilize these abilities illustrates a lack of leader- 
ship. In this effort I quickly learned the advantage 
of recruiting and utilizing talented sttbordinate assis- 
tance. Based on some less than desil^ble' experiences 
in Prat^ticum Maxi I, I learned to closely supervise this 
delegated /assistance ind to provide positive reinforce- 
ment when competent 4ork was manifested. Both subordinates 
and superiors seem to cooperate ^tter if there is something 
in the plan for them that happeni^ \o correspond with their 
personal objectives. 



This practlicum certainly taught me some real lessons 
concerning the elusive nature of power. As indicated 
earlier, the practicum became a reality even when most 
Individuals were telling me that it was not possible 
to actually implement. Then, just as I unexpectedly 
sat back and enjoyed various successes, I would suddenly 
find obstacles. Some obstacles nearly destroyed the 
plan at times. 
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Power seemed to surge and ebb suddenly and unexpec- 
tedly. Being "In the real action" seens to expose one 
to this kind of change. When a program is beginning to 
energe, there are always those who say "No!" However, 
after It slowly begins, individuals an>^ obstacles seem 
to ignore the effort because the "territorial Imperative" 
is determined. Later, when a change- becomes extensive, 
as this one dld^ many Individuals Income concerned^ As^ 
the monitor and review imit grew^^ many professional 
staff members became keenly Interested because the acti- 
vities began to infringe upon their territory, 

I did not adequately prepare for this sudden 
interest • However^ these experiences have taught me 
to closely anticipate such interest and concern when 
a program becomes strong. In the future I shall flow- 
chart these variables Just as closely as the activities 
leading to completion of the anticipated outcome « 

A hard lesson I learned in this praeticum imple- 
mentation is the necessity for Involving many people* 
tn the future I shall carefully analyze who might be 
affected by one of my proposed educational changes* 
Then I shall cover bases by getting as much concurrence 
as possible at an early stage « People are more supportive 
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If they are li^volved In -the development of the program 
from the beginning. These coneeme can be articulated 
and changes can usually be made to accommodate their 
Interests. If compromise is impossible with a few, 
one at least has general consensus which can negate the 
very few individuals who do not have the common good 
in mind. More significantly, the plan can be enhanced 
bj benefiting from additional Input, 

I was resiarkably successful^ ih practicing involve- 
Bwnt with the county offices of education, and the 
rewards were considerable. Next time I will attempt to 
Involve more tmlts. Although I involved a few district 

0 

representatives to monitor our efforts, 7. should have 
Involved them in a structural, intensive manner,, 

I certainly learned that it is worthwhile to attach ( 
one*s objective to other new ideas. My decisions to 
Include cotanty offices was based upon a slowly emerging 
new relationship with these offices and the Department 
of Education. My proposal happened to provide a very ^ 
concrete example for a new i 'ley. The new marriage 
was quickly approved. The new working relationship tended 
to become as Importoat as my original objective. Moreover, 
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this relationship provided stability for the fledging 
program when there were many obatadea to aucceaa. 



I am an advocate of the fact that educational 
change ultimately is Implemented at the local achool 
level* and my practlcums reflected this phllbaophy. ' 
However, my recent experiences have begun to convince 
■e that it la myopic to believe that total change - 
really happens exclusively at that level. 

The level of accountability I have eatabliahed 
through this monitoring effort will have baused conaider- 
able changes in yundreds of schools. Although special 
funds have been provided to these schools, many of the 
programs seem to falter without leaderahlp* Our regula-- 
tlons provide generic management and curricular operations 
which are based upon research and empirical evidence, 
••get needs assessme^. j establlishroent of objectives, 
specific management processes, etc* Some schools have ^ 
a tendency to accept categorical money without really 
changing existing programs* Now, with our on-site 
monitor and review teams, we can ensure accountability 
and provide professional asslstancee 
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During my professional career^ I have cllabed 
through the local school teacher^admlnlstrator ladder 
and respect the activity at that level. HoMever« the 
reports I have seen and the follow-up evaluations I 
liave ttade« have convinced jne that the state Is exercising 
necessary positive leadership In Improving programs for 
children. Ttie Federal Government does not have the 
effective power due to Constitutional and geographic 
llnltations. Many districts and -schools are bound hy 
tradition and immobility. For example, it is politically 
difficult to place extra help in low-income minority 
schools. Secondly, with the shortage of money, additional 
local dollars are now often going to salaries rather 
than innovative programs. 

Based upon my experiences in this practlcum, I 
believe we are developing an excellent accountability 
system which will result in Improved programs at local ^ 
levels. Thus, I have learned that educational change 
occurs at many different levels. There were just too 
many pro^^rams that needed improvement to conclude that 
all educ^ional change occurs at the local level. I 
have learned that a cooperative network which unites 
schools and an effective state department is essential. 
All of these agencies must have good leadership if equal 
educat'lonal opportunities are to become a reality. 
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Finally, I have learned that a well designed and 
executed practlcum can result In a new Job. After I 
Introduced the proposal and It was approved, I wasV 
assigned to Implement It on an Interim basis. In \ 
spite of any rough edges or mistakes I made In compler 
my work, my program manager was quite pleased' with the 
educational change. As a result, I was asked to per- 
manently remfiln and assume additional, responsibilities 
for high level planning. ' ^ 



IV. CONCLUSION 

The objective established for this practlcum ^as 
been completed. In January of 1974, California had a 
consolidated application, but no consolidated method of 
■onltorlng and reviewing all of the programs In a con- 
solldiBted manner. One year later a system vas thorouc^ly 
developed. The Consolidated Pilot Monitor and Review 
effort extended to 17 programs In 74 school site's. The 
full review system anticipates servicing 4l4 school 
sites in 71 districts. 

California is the first of the seven COORAjM states 
with a consolidate^) approval SQrstem which also has a 
systematic monitor and review oiethod which provides 
the .data necessary to make decisions concerning continued 
funding of individual programs. Monitoring Instruments 
and systems have been developed uhlch will provide this 
dat8« 

California now h^s a system for monitoring and 
reviewing operational programs so tha^ one can analyze 
multiple programs In action at a school slte^ The 
relationships J:>etween these programs can be observed 
so that the California State Department pf Education 
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can determine whether Individual programa are being 
la4>leinented In accordance with the law and whether 
funda are being uaed optimally In terna of the total 
aoMvlty at the alte. 

All of the algnlflcant taaka neceaaary to develop 
thla ayatem were accompli ahed. Starting without ataff 
and procedurea, a amall planning team began to emerge. 
From theae Initial effort a more ataff began to aaaemble 
for the effort. Slowly, Instrumenta and procedurea 
began to take place. Increaalngly buay typewrltera 
began to pound out mesaagea, inatruments, nemoranda« 
conference and Inservice aeaslon lettera^ and final 
reports. Life was breathed into a procesa that, based 
upon a review of the literature, did not previously exiat. 

Sometimea, a procesa can be aa Important aa the 
objective Itself. Frequently, it is desirable to 
develop a process to bring staff together. In this ! 
practlcum effort* one of the mile a tones- called for a 
cXoae working relationship with California 'a 38 county 
offices. The milestone waa satisfactorily completed 
and the new close working relationship, i.e., a 'total 
of 109 county staff working and traveling throughout 
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the state In a Joint effort becams as significant as 
developing the system itself. Such was the case with 
the new state-county effort. For the first time, the 
state and intermediate levels were working In an identical 
fianner on an identical program. The Callforhia State 
legislature, recognizing the value of this effort, made 
a substantial sum of money available to pay for the 
travel and per diem expenses of the county staff members. 

Although the objective has been completed, the 
system is not totally in conformity with bqt expectations. 
A "real-world" effort that affects people, money, and 
an educational system seldolm f^presents the will of on*' 
person. So be it with this pr^ctictm. Segments of 
the modified instrument's philosophy and procedures 
were divergent from my personal desire. The intents 
of many people become merged In a large-scale effort. 

One must accept such changes in a positive sense 
and keep the overall objective in mind.. This perspec- 
tive^ generally with my will and sometimes as a result 
of being overwhelmed, has been maintained. Compared to 
the total thrusts, the undesirable reiterations tended to 
be non-substantive. The system I Intended to creaite 
clearly exists. ^ 
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The program has dlx^ctly assisted children and 
staff at the school level. In addition to the hundreds 
of schools directly visited, many schools are malclng 
their programs more accoiintahle to children because of 
anticipation of our visits. Every eligible school 
has received copies of these forms. Most schools, 
assisted by their central offices are conducting their 
OMi self^analysls. Some districts even modified our 
forms ^and conducted their own formal reviews. 

Th^se by-products seem to constitute a cost-effective 
manner ot\ providing Inservlce educaHon at the local 
school site level. In effect, the MAR instrument can 
be used as a concise inservlce document for principals 
and teachers. ^ 

At the school level, many principals, teacher^, 
parents and community leaders are currently using the 
Instzniment to improve their educational programs. 
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V. FOLLOW-UP 



Change may be an Important ingredient in life 
generally, but It is absolutely fundamental In education 
and bureaucracies. The monitor and review effort, which 
I started, impacted 17 programs and 7^ school sites in 
the pilot effort and will have extended to 71 programs 
and ^14 sites during the first year of full implementa- 
tion. Although the original objective remains unchanged, 
the procedures, personnel, and style are constantly 
evolving. 

Now my duties have been extended and I can no 
longer work intensively with the effort, but the respon- 
sibility for this new procedure is still within my 
unit's Jurisdiction. Therefore, I will be in a position 
to follow-up the effort. For example, I intend to Iceep 
abreast of the new changes in federal law, because the 
new federal law will change the cumpliance procedures.^ 
State *-laws are also changing and state procedures have 
traditionally changed from year-to-year. I intended 
to design a system which could absorb these changes. 
Some of ray follow-up activities will test this hypo- 
thesis. 
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I evaluated the pilot effort, which was nty primary 
area of reaponslblllty for thia practlcun, and other 
atsff will evaluate the long-range effort. Part of the 
future evaluation, pexiiaps next year, ahould determine 
the coxTelation between academic student achievement 
on the one hand and compliance and quality aase^ament 
on the other. Although this evaluation )flll not be my 
responsibility^ I do Intend to make these kinds of 
recommendations. ^ 

Part of my continuing follow-up activity has con- 
sisted of analyzing the reports uhlch have been submitted 
to the first of the 71 districts and 414 schools. Most 
of our visits have helped local school staff — in other 
cases^ some difficulties resulted. I am keenly interested 
In the working relationships and reasons why such 
differences occur. 

An ongoing follow-up activity which has already 
been directly assigned to me is to work with all 58 
county superintendents in order to design their entry 
Into the total delivery system. Therefore, I contln- 
uoualy monitor the activities of all county office staff 
complaints by serving as a "hot-line" liaison. The 
new Joint Planning Committee working with ne for total 
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entry into the systen will decide where the present 
87 county staff should be ^allocated next year, if 
additional staff nill be asaigried^ and how mt shall 
ultimately involve districts. 

Finally^ I Intend to analyze the system in order 
to find ways that technology can be applied. Considering 
the fuel crisis and the declining dollars available to 
education, we nay need to find ways to make the system 
more cost-effective. Finally, legislative recommendations 
Hill be made to the Superintendent of Public Instruction 
for hl9 consideration in makingf recommended legislati^ 
changes which will further support consolidation of 
services and potential funding for the new accountability 
system and the new relationships with county offices. 
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PROGRA!!S REVIEIJED DURING 
PILOT REVIEVI 





TRAM A 


liivjl oil 




"Week of 


■ District 


County 


MA R Rp cfT on 


March 18 


Mafnmoth 


Mono 


I 


25 


Anderson Valley 


Mendocino 


I 


.April 1 


Pleasant Ridge Elem# 


Nevada 


If 




uroYXXxc ii(X6ni« 


DXXhZQ 


I 


22 • 


Konocti iJnified 


Lake (Co-op 6 Dist,) 


., I 


29 


Ilarysville^ 


Yolo (10 PS, 1 NPS) 


II. 


lAay 13 , 


Ukiah ^^""^ 


'Mendocino 


I 


20 


Pajaro Valley 


Santa Cruz (? PS) 


III 


27 1 


Modesto^ ' \ 


Stanislaus (lOPS, 1 NPS) 


II 



I larch 18 
25 

April 1 
■ 15 



May 



6 
20 

27 



Briggs 
Heber 

Reef Sunset 
Beaiunont 
Kings Canyon 
Oxnard*^ 
Lompoc 

Riverside U.-^- 



TEAM B - South 

Ventura 
^ ' : Imperial 
Kings 

Riverside (3PS) 
, Fresno (7 PS, 1 NPS) 
Ventura (A PS) , 
Sfenta Barbara (3 PS, 1 NPS^ 
Riverside 



IV 
VI 
IV 
VI 
II 
IV 
IV 
VI 



*Pre-school 

MR/sb50c3M 
1 
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Evaluation Report of the 
Pilot Monitor and Review 
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PRI.FACE 



The Superintendent of Public Instruction has reorganized the California 
State Department of Education so that a new delivery GyGtem vrill provide 
a comprehensive approach /to education. In oi*der to accoirimbdate the highly 
individualized needs of students in California's pluralistic school 
systems^ the Department of Education must provide a delivery system which 
encourages local districts to implement previously fragmented programs 
within a consolidated framework. 

The new delivery system consists of Comprehensive District and School-Level 
Program Planning, Consolidated Applications for Funding, Consolidated Monitor 
and Review, and Promising Practices. The first two functions of the new 
system have now become fully operational. 

Responsibility for developing the third function. Consolidate Monitpr and 
Review, was assigned to this office. Subsequently, a pilot MAR process was ^ 
established and field tested during the Sprinn of 197ii. This report reflects 
the activities which have occurred in the joim. State-county effort during 
197>74- 

Responsibility for the pilot I4AR effort v/as assumed by Edv/ard L. Bispo, 
who was assisted by Frank L. Wallace. Following Cabinet approval of the 
overall plan, a joint county-State planning team was assembled to develop 
the instruments and administrative procedures to be used during the field 
pilot MAR process. This planning team, operating under the leadership of 
Mr. Bispo, included William Zachmeier, Santa Cruz County; Martin Bauman, 
Placer County; Margery Ruby, Stanislaus County; Erven Brundage, San Diego 
County; and J^ck Beckett, Marion Faustman, David Hammond and Arthur Jensen 
from the Department of Education. 

Credit for this nev/. partnership is attributable to the efforts of Don McKinley, 
Chief Deputy Superintendent of Public Instruction, and the six county super- 
intendent Area Chairmen who worked go closely with- him:, Neal Wade, Ray Darby, 
Milt Goodrich, Ace Nelson, Jim Cowan and Louis Delsol, plus Glenn Hoffman, 
Walter Eagan and Ted Dixon. Special recognition should also be given to 
Neal Wade, Superintendent, Stanislaus County, for his outstanding efforts in 
hosting the joint inservice training program and his significant commitment 
to making the pilot effort a success. 



William E. Webster 

Education Program Administrator 



Rex C. Fortune, Jr. 
Associate Superintendent 
Secondary/Adult Education 
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REPOHT Oy THE PILOT 
MONITOR AND REVIEW PROGRAM 



SUMH/UIY 



Monitor and review of state ar.d federal programs is required by law. In order to 
neet the mandate » two pilot r.onitor and review teans, A and B# were formed to 
field test an innovative monitor and review process and to evaluate the pilot 
instruxr^nty M-127, which was developed for the specific purpose of clarifying pro- 
gram rcqui'renents. The chief purpose of the MAR process was to determine district 
compliance with the regulations. For most districts, the pilot MAR visit was the 
only site review they had received from the State Department of Education, The 
MAR team members found it necessary to go beyond the icope of mere compliance in 
order to meet the needs of the districts who were recipients of the review pro* 
cess. All requests for assistance were addressed and alternative approaches to 
educational programs were given by MAR team members who recommended changes vital 
to program quality, 

OBJECTIVES - 1973-74 
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, By February 1974 the Departir^nt will establish a MAR system, including 
a consolidated. >L\R instrument (M-127), to be used to review all spe- 
cially funded prc^rar:^s included in the consolidated- application. 

This objective was met. 

In addition, by February 1974, auxiliary instruments will be prepared to 
be used for review of selected specially funded programs not presently 
Included in the consolidated application. 

Auxiliary' instrur.ents were prepared, although specially funded programs 
not presently included in the consolidated application were not..monicored 
aud reviewed. 

, By July 1974 two D^partrrent teams, vifh assistance from LEAs, using 
the consolidated M-l? 7'.ir*3tru!;onc and .auxiliary inStrurents, will review 
specially fu::ded procra^iS in twenty districts (or inulti-district coopera- 
tives) interested in participating on « vpluntary basis. 

Seventy-four school sites and 17 dist>^cts were monitored and reviewed, 
(Refer to chart' on pfiges 3-6.) 

, By February 1974 the Department will establish a complaint procedures 
unit within the M\R structure which will respond, when appropriate, to 
citizen ccsTjlainto USOE audits, Gf\0 audits, and legal suits. 

Materials and procedures for handling coxplnints have been developed by 
the State Daoartnient of Education. A con^i^l&inc unit was not organized 
during the pilot ^L^R due to lack of staff snd time; however, at Icawt one 
monitor and review visit was rn^de to the district in 4n3wer to a com- 
plaint. ^M^^ 

9^ 159 



5. By July 1974 the Df^:^artn:<?nt , with nsststance fron> participating LEAs, 

will develop n syacci for identifying, prcnising practices resulting from 
.the planning for and iicplementation of comprehensive programs. 

A system for identifying promising practices will be met by the target 
date specified in the objective. 

OTHER PRODUCTS OP THE MAR PROCESS WERE: 

1. The visiting of 17 school districts to assess effectively the extent of 
ccrpliance and providir.?^ on-site and follcv-up assistance to district 
personn)sl by reviewing program requircr*5nts through direct use of: 

a. The M-127, 

b. The MAR field visit ^nd exit interview. 

c. Final MAR report to district. 

2. -The 'gathering of data concerning the n:ost conrnonly found elements of com- 
mendation. 

3. The ga^lering of data concerning the most cotnmonly found elements of non- 
compliance. 

4. The developing of an effective MAR procedure to lessen future problems in 
the district vhich contained a 

, a. Pre-visit. 

b. Review visit - orientation, on-nite reviews, exit interview. 

c. A report to district. 

d. Follow-up assistance. 

5. The creating of a positive attitude toward program improvement at the 
district and LLA level. 

6. The recosrr.ending of changes directed toward program compliance and qual- 
ity. 
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MAR PROGRAM IMPLEMEmTION . 1 

There were several aspects of the MAR implementation worth noting, and one of the 
moat important 9 was county office involvement* | 

County Office Inyolveinent 

Codfnty personnel worked in cooperation with State Department HAR team nembcra in 
planning y : ? lamenting, and evaluating all phases of the monitor and review pro- 
cess, including the inservice training, Edward ,Bispo, Arthur Jensen, David Haimnond, 
Jack Beckett, Marion Faustrcan, Margery Ruby, Williaa Zachmeicr, Martin Bauman, and 
,Erven Brundaj^e were on the Planning Committee. 

Inservice Trainin g 

On March 12-15, 1974, a successful Inservice training program vaa held for all - 
State Department and county personnel taking. part In the pilot MAR process. The 
>IAR procedure, back-up docuinents, and other necessary information were thoroughly 
reviewed. Cocrrents v;*re distributed and choices r::3de by county personnel as to 
districts they wished to visit for the monitor and review process, and the dates 
of visitation. 

K\R Visitation 

Information as to ccr^oliance was provided the districts and specific suggestions 
and Tutorials vnre given to lirprove educational proerars when requests for such 
assistance were received. Visits vcre made to 17 districts by two MAR teams. 

Evfllualion ^ 

The forms for evaluating the process were reviewed and approved by the planning 
group which ret June 10. 



The follcving persons served on the Planning Ccraittee for evaluation of the K^R 
ptoccss. 

Ray Kelscn, Kcniocino Countv State Departr,cnt: 

Martin Fn;.-: in,^ i' lacer .County ' John Apple 

>Srgcry' ?.Ay, "iSLanislaus C-ouaty Jf.ck BccV*ett 

.Al Reetz i Sdntn Cx'jz Con:\t / Arthur Jonson 

Ron Hod wait, Snn i^iepo County , Frank Pi .> era to 

Ron Hi :*es , .Tch^i a County ^ \ David . I'a.rr^ond 

^ Kent Holtzcl^w, Shasta County ' . Zelr.a Solonon 

Conchislons frcn t^jf^ evaluation were obtained from the M-127 ln<^trut:H2nt , the tele- 
phctic- survey, ^r.d t\\a tolltr-'-up IntorunLion frc:.i dUtricta. There will also bti 
additional infcr:r.ati9n frc;.i the county personn*-! wno took part in the nonitor and 
review proccoS , at a later date. 
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CONCLUSIOMS FROM THE MONITOR AND REVIEW SURVEY 



The monitor and review process developed into « successful means through which 
•chool districts not only were made aware of non-cor.pl iance, h^z also were 
. approached jfi such a way that school personnel Were motivated to improve programs. 

The Monitor and Review teams worked as a unit with excellent cooperation in evi* 
dence between the county office and State Department members. ^ 

The M-127 instrument proved effective in identifying tl\e speci^tlf^WNiM^of na# 
compliance^ aad in clarifying the requirenents of state and federal laws. The 
^*i4-427 also indipated to the school districts the full array of compliance require- 
ments. The process utilized the instxniment with a minimum of modification. 

RECOMMENDATIONS FOR yO!aTOS AKD REVIEW ^ 

TO BE YSfJ^ AS PRCGFA^i REVIEW AIJD. IMPROVEMENT (PRI) - 1974-75 ® 

The following reco:n:»endatlons were made after a car^eful perusal of the evaluation 
responses from districts woo had been monitored, cobnty personnel, HAR team members 

1. The Monitor and Review team (PRI) continue in operation. 

2. The monitor and review (PRJ) should continue to go beyond the area of 
co:?pliance ^nd develop more fully its capiicity to deal with program 
quality. 

3. Continue the M-127 vith the necessary modifications 'to bring the instru- 
ment in accora vrith changes in the law. y 

Continue to work with county personnel, making the number of days service 
^ from the county reasonaoie in vi w of other responsibilities, rleet with 
the county personnel concerning this, and plan on individual differences. 

5, Either increase the mir.bcr serving^ on each M^R team (PRI), particularly 
for the larger districts^ or inc^^ase the time spent in each district. 

6, The school district r.onitored felt the desire to ir.prove school program 
quality becusc of th-j. hclpiul, non- threatening posture of M/iR, This 
aspect should be kept in PRI. 

I 

i 

7, Flr.n two exit interviews; one at the school level, and one at the district 
level, 

8, Fl'3\ for a follow-up from the PRI visit, at a later date, to help improve 
program quality at district rGouest . 

9, Tncor^orntt> the same dct-.ocratic team spirit that wde MAR successful into 
the PRJ. Knvolvin?; tnc rrs:>onsibi lity cf tcr.n leader, ;^iving each team 
ticmber who desires thin a\pcr ien^**^. , a chance to^ serve, vouid net only 
strcns'.lhcn the team spirit, out wouM al^o lead to the understanding of 
the responsibilities uvA prcssuxes ojC the team leader's role, 'strengthen- 
ing loyalty. 

er|c , iJ'S 
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10. There ncc4s to be interface between the monitor and review function (PRI) 
and the Early Childhood Education monitoring teams. 

11. • Coirriiunication needs to be improved between the PRI and RST in order to 

clarify directions for school districts. All interpretati^ons of school 
regulations should be xonsls'tent. 

12. Title VII, 2234, and other programs need to work In cooperation with PRI 
in order to insure that interpretation of regulations are consistent. 

13. Written reports should be received by school districts at least two weeks 
after the PRI visit. 



/ 
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ADDENDA I 



MAR EVALUATION PHONE SURVEY 
' 1973-74 
June 



/ 

/ 



/ 



yumber 

Questions Asked and Type of Response Responding 

(N-34) 

!• WHAT WERE YOUR IMPRESSIONS OF , THE MONITOR AND REVIEW VISIT? 
Positive Re<:nonscs ; 

"Great:" '^Very pleased." •'Most helpful." • 16 

Report well done 8 

Iinpressed with organization and process 3 

Helped to clarify requirements \ • J ^ 

InstruHient was excellent ^ ^v^^ 6 ^ 

Did a great job of explaining process « 7 

The VA& process was non-threatening. It made the district ^ 
personnel want ta icrprove 

The approach was a very positive one 4 

Excellent. Gave us a cnance to really review our program • . • ' 2 

The district personnel were iinpressed with the teams* 

wlllinc^nesa to talk to teachers, aides^ students, and 1 

parents .7^ , • • . • 

The team demonstrated an attitude of reinforcement and 

assistance / • « ^ 

The school staff was itnpressed and felt the MAR team was 

interested xn hel^ng iirprove the program 4 

ThC|^Jl\R pfrocess strengthened respect for categorical aid 

ptogrnins in the school district 1 

Very happy with approach. Forriit and people who served on 

MAR were very helpful r 5 

Liked objectivity of vholc MVR approach , 17 

Program suggestions were helpful ... 13 

The team came 1^ with the attitude that »those in the 

school district were also professionals * 3 

The written report was the same as the suggestions made in 

the exit interview. This was appreciated 1> 

A very perceptive group of people 9 

The most intelligent team that has visited the ^listrict 3 

MAR won over our district 2 



/ 
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Questions Arked and Typo of Response 



' Namber 
Responding 



Exccll^nt^on all counta • . • 

Negative Responses ; 

Parents and teachers vere confused by exit interview. They 
were unable to distkiguish between coxxanendations and 
auggestions - 

Exit interview was too general, and the language too technical . 

2. HOtf WERE SC|OOL DISTRICTS CHANGED AS A CONSEQUENCE OF THE WAR VISIT? 

Corrected misuse of atides on playgrounds ' 

MAR had led to ir:provcinent. of individual school programs in 

relation to student pro^l^s and individualization of 

instruction 

• • \ *. 

MAR caused us to initiate the use of student profiles 

Helped the director to i:=prove the pro^reSrby the MAR's 
insistence to comply , 

The staff development coinponent was icproved and increased • • • 

The district will itaplement all suggestions forthwith 

District will ccn?ly with the labeling of equipment . . ^ 

We have already zr.adQ plans to rcvanrp the entire intermediate 

school to corrply with non- isolation requirements . 

State-required pro^^rani icprovement surgestions definitely 

helped the director to inprove the program 

The MAR visit enforced the changes the director wished 

to mke ..4...,, 

Since the VAR visit, the district has iirproved the program 
foe disseaination of ir.forcation, especially to other 
schcolfl in the district 

^Budj^eting procedure was revised to r-eet conrpliance 

Dd strict revis^^ proccciure for icient ifyir.g .eligible students 
'in otdffj* to ccurply vith regulations 

3. HOVr-^ULD 2i\R PROCESS BE lypROVED? 

No itsiprovement needs to be suggested 

Teem should \c in district longer period of ticae, or \lan to 
have additional staff 

«• 

Have tvo exit Interviews: One for the district staff and 
one for general staff r.cabers, parents, and aides . . . 



8 



1 
1 



10 
2 

4- 
5 
16 
4 

1 

8 

7 

5 
2 



3 
4 
3 
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( Mumber 

Questions Asked and Type of Response Responding 

(N«34) 

Definitely make follov-up visits to schools 11 

Bach MiVR inenber be made responsible for one particular 

school and cover all areas for that school 2 

Bach school should be totally reviewed by the M-127 

instrument 1 

Reduce apprehension of district prior to visit 1 



J 
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MAR EVALUATION SURVEY 
1973-74 



This information was not necessarily initiated by telephone, but 
was volunteered, and through a process of content analysis, has 
been categorized under 10 headings. 



1. WHAT^ PROGRAM CHANGES WERE MAD? IN THE DISTRICT DIRECTLY ATTRIBUTABLE TO THE 
MAR VISIT? 

Individualized learning will be planned for all classrooms, 

A district-wide plan for disseminiation has beeq developed due to the MAR 
team visit, - 

Since MAR visit, district developed school level assistance teams consisting 
of teacher, parent, and administrator who visit from school to school for 
monitor and review purposes. 

MAR has spurred the district development of a card file system to keep lists 
of eligible children currertt. 

Inventory of equipcsent' has. taken place due to a MAR suggestion. 

MAR team has caused the school district to develop an intense process of diag-* 
nosis and prescriptive teaching. - , 

The district will correct all problems found by MAR. 

2. VERB TV^ RECC::>!5:N'DATI0:tS H\DE'AT tie exit IOTERVIEW IKPiEMEKTED, OR HAVE PLAIJS 
BEEN VADZ TO I2-!PLEH£:rr TR2 RCCOIC'^EKDATIONS? / 

All suggestions will be implemented. 

Plans have been made to follow through with all suggestions made. 

r 

Suggestions were well received and will be the basis of program development 
next year. 

Staff develcpnent which was weak has improved. . 

Parent participation is ir::provcd, and parents are more cooperative since they 
better understand the program when explained by MAR at the exit interview. 

The district office has been giving more aid to schools and there is more 
cooperation since the M\R visit, due to suggestions made. 

Scheduling and form foriivat was beautiful I 
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3. WAS .THE MHE THE VAR TEAM. SPENT IN YOUR DISTRICT ADEQUATE TO INDICATE THE 
HEEDS OF YOUR PROGRAM? 

LONbER. 6 Answered 

TIME SHOULD -HAVE BEEN ADEQUATE . (Circle One) 10 Answered 

SHORTER. 



None thought the team shotild spend a shorter time in the district. ^ 
Plan to be in the school an additional day. 
..Meet with the Advisory Conimittee, as well as all staff tnewbers. 

4. (a) mS YOUR DISTRlfrr SUPERHrTEMDENT (HAVE YOU) RECEKED YOUR FTKAL PROGRAM 
REViri^ REPORT? 

, ' 10 Answered Yes 

7 " No 

(b) WAS THE Fim REPORT HELPFUL IN GIVIKG DIRECTIONS OR ALTERNATIVES FOR 
IMPROVING YOUR PPvOGRAM? 

A written report is necessary for follow- through. 

A written report should follow closely the visit to the district if a 
follow- through program is to be planned and ijqjienented in a reasonable 
length of ti:::e. 

The school board asked about the written report. 

The written report was disseminated to all principals in the district, to 
the parents, and to the board xuembfers. 

The final report was most helpful in giving suggestions which helped us 

to iinprove our procram. (>:ost agreed with this ststcicent. None disagreed.) 

). IN ;nL\T WAYS WAS THE M-\R VISIT BENEFICIAL TO YOUR STAFF? 

MAR did a p^veat job or erolainint! the problems in the district and the staff 
haa a handle on what needs to be done, and is doing it. 

The program was very beneficial to the staff. 

We liked the stating of guidelines specifically; this helped staff to gain 
inipetus to make itrprovements. 

fi *■ 
Made staff more awar^t of categorical requirements. 

The >UR visit was beneficial in that the visit brought about cooipliance at the 
district level. 
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5, IN WH.\T WAYS WAS THS M\R VISIT BENEFICIAL TO YOUR STAFF? (ContJ 

The teao's epproach was pointed and gave definite direction; this was helpful. 
Yes, awareness of program. ^ 
Helped build staff morale. 

It made the staff take a look at community and seek involvement, 

> « 

6. WOULD YOU LIIOS TO H.\VE TKS MAR TEAM FOLLOW UP WITH CONCRETE PROGRAM IMPROVE- 
MENT SUGGEST 10}? S IH YOUR DISTRICT? 

Would be beneficial to the district. 

Definitely, a follov-up visit by MAR to help the district with compliance and 
program quality would be welcome, 

c l^o, we've already implemented all suggestions. We do not object to a visit 
after a period of time to see if we have maintained quality. 

Yes— 

A visit from such a great team would be welcome. 

Concrete program suggestions have already been received by the team. 
We would definitely want a follow-up from the MAR team only, 
' Yes, if from the MA.R team, 

7,,, WIIAT WAS THE IMPACT OF THE MONITOR AND REVIEW TEAM VISIT ON YOUR SCHOOL DIS- 
TRICT PROGRAM? 

• *• 
Real, ' 

The tenra did a very impressive professional monitoring and review. 

Felt iqpcct was good and. helped. 

We plan to ic^ler.ent all the concerns the team brought out. 
Very beneficial intact. 

The IL\R team visit changed our district for the better. 
Good, 

Very beneficial. 

We'll never be the saac^-only better, 
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Products of Objectives: Impression of MAR Results in Your District: 

Excellent Good Fair goor 

1. The use of the M-127 In- 
strument in reviewing pro* 

gram requirements: 4 8 

a. The field visit 3 9 

b. Final MAR exit interview A 8 

c. Final written report 3 7' 

2, List of coraendation 10 7 
3* List of non-compliance 10 5 

4# To^rovide on-site assistance ' 

to the projects 6 4 1 * 

'5« To effectively assess extent 

Ot CCI2^ liance 5 6 

6. Effective K\R procedure to 
/ prevent future problenis in 

the district through the: 

a. Pre-visit .5 6 ^ 

b. ^ Field visit \ 4 9 

c. Exit interview 6 10 

d. Report to district ,9 7 

7. Create positive, .attitude' 

' toward program ii::provement 15 2 

8# To recorrrnend changes vital 

to program quality 13 4 

8. OTiiZR co>:^E:n:s: 

It was a zood experience for the team did not judge, it was helpful • 

The team did not rate us 8o?we could be truthful and receive help. 

A very professional team; we were impressed. 

The team did a most thorough job. 

Team provided v«lid informntion. 

The team did a great job of explaining proceso. 



Addenda II 



8. OTHER COKMEOTS (Cont.) 



We are very happy with the MAR process as it did not rank or rate; It was 
non^threatening. 

State did itself prcud sending a team likf. that* 

9. ALTERNATIVE SUGGESTIONS: 

Make follow-up visits to the schools. 

Have the Mr\R team handle all programs— • ECS, ESEA Title I, etc» 

Make exit interview at ^chool as well as in district office. 

Have the H\R team ineDl|er8 stay all day at a school site. 

Best team ever visited our school in that we throught they were really in- 
terested in our little district and in good e4ucat ion here. Spend a longer 
time in the district and cctne back once during the year. 

10. WHAT CHANGES* WOULD YOU MAKE IN THE MAR PROCESS: 
See Above. 

One superintendent stated that all school district personnel should interpret 
the laws for themselves without interferences. 
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SURVEY OF MAR VISITS 



Intcrvlewa with : 

Superintendent 
Business Manager 
Principal 
Resource Teacher 
Classroom Teacher 
Aide 

Advisory ConsiitCee Mecber 
Parent 

Progrjam Director 



Total Wo . 
of Intervlcvs 
by Category 

51 

34 
119* 
119 
289 
153 
153 
187 
162 



No. of Visits Made to the 
Folloving Categories Per 
MAR Session 

.3 

2 

7 

7 
17 

9 

9 

8 
11 



Number of V.isito to ; 

Non-ECE Classroons 
ECE Classrooms 



Total Visits 

272 
102 



Av. No. of Classrooms 
Per Visit - 

16 



Title 8pent in : 

Cla^roota Observation 
Evaluating Data 
,, Writing Report 

Reviewing Documents 



Total Hours 

85 
187 
119 
119 



Av. Hours Spent at 
Each r.\R Session 

'•5 
11 

7 

7 
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FORMS USED TO EVALUATE MAR, 
SEE PAGES 10-17 



SURVEY OF PROJECT DIRECTORS 
QUESTIONS FOR PHONING - 
FOR MAR EVALUATION 



1. What were your inpresslons of the monitor and review visit? 



/ 



/ 



/ 



2« How were school districts changed as a consequence of the inonltor and review 
visit? 



3« Hov could MAR process be ic];>roved? 
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MAR Evaluation Survey 
1973-7'* 

In order to help us improve our procedure and instrument, please an-^er the following questi 
1. What progran changes vere made in the district directly attributable to the MAR* Visit? 



r 



2. Were the reconnendations rade at the exit inte -viev L^plemented, or have plans been made- 
to implement the recoraendations? 



>73-74 MMl Evaluation Survey . 

- ' . \ 

Was the tine the MAR team ^pent in your district adequate to indicate the needs of your 
program? 

longer. y 
Time should have been adequate* (circle one) ^ 

shorter. 

r 

Coinnentt \ * — ^ ^ — — 




J 

.e)Has your district superinten^^;.t (have you ) received your final program review report? 
' yes or No 

(circle which) " ^ 

b) Was the final report helpful in giving directions or alternativeG for inproving your 
program? 




1973-74 yjyR Evaluation Survey 

5* In what ways was the MAR visit beneficial to your staff? 




6» Would you like to have the VAJ{ team follov uv with concrete program inprovenent sug- 
gestions in your district? 



/ 
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1973-74 MAR Evaluation Survey 



Vhat was the impact of the Ilonitor and Review tetun visit on your school aistrict procrar? 



Prcr^xictfi of On i c^cti vf^s : 



Tn r^rossion of !IAR results in your. District 



1. , To use the M-127 Instrunejit in reviewing 
proTr*'! r "^uir orient s : 



Excel lent 



Good 



fair 



Pobr 

i 



2. List of ccrriendaticn 



1. List of non-ccr.r>iiaar'? 



%» To provide on-site a?>sistance to the 
pro J eels 



i. To effect ivel 



''eiy assess extent ot con^piiance 



>• Effoctivo I!a-*. proccJure to prcverX future 
proMc^.' -ho fii'^.zrict iL:rv .the: 



\ Create positive attitude to\/ard program 
improvencnt 

i. To rccorrmend chorij^es vital to progcam 
qual ity 
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MAR Evaluation Survey 
Other corments : 



^ 

Alternative suggestions: 



hat changes vould you sake in the MAR process 
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Consolidated Monitor and Revie\^ Procedures 
(Revised January 22, 197^) 
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CALIFORNU 5TATE DEPARTMENT OF EDUCATION 



Consolidated Monitor and Reviev Procedures 
(Revised. January 22, 1974) 



Dr. Rex Fortune^ 
Associate Superintendent 
Secondary /Adult Education 



PREFACE 



The Superintendent of Public Instraction has reorganized the California 
State Department of Education so that a new delivery system v.all provide 
a comprehensive approach to educatiun. In order to accommodate the iiighly 
individualized needs of students in oilLifomia's pluralistic school rystems/ 
the Department of Education must provide a delivery system which encourages 
local districts to inplement previoaL'ly fragmented programs ;d.thin a 
consolidated framev/ork. 

The nev; delivery system consists of Comprehensive Disti^ict and 'School-Level 
Program Plannirt^, Consolidate'] Applications for F^jnliing, Consolidated 
I'onitor and Re^qfe;;, and Proriaing PraQtlces, The firjt Iv/o fionctions of 
the nev; system have nov; becor.e f^olly operatioriai. 

Administrative responsibiLLty for the preparation of this proposal-^ was acsuT.ed 
cy Edv;ard Bispo who was assisted by Art Jensen, Co:::pensatory Education 
3\pport Actirlty Unit, and Fran.: Vhllace, Secondary/Adul^ Education. Manuel 
Ceja, Corrpensatory Education 'lanagor, has pro^vri ied valuable input in reviewing 
and prO'/iding significant additions to this proposai. 



Rex fortune , 

Associate 3 :perinLendent 

S-^condary/Adult L/iucation 



Re//ised Jan-ja^; 
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CONSOLIDATED MONITOR AND REVIEW SERVICES 



Goal Statement 

The Department of Education believes that local education agencies 
must design and implement instructional programs vhich accommodate 
the highly individualized needs of every student, whether the student is 
Just entering school or is participating in a specialized program as a 
■ature adult. Within California's pluralistic society, these needs are 
often very diverse, including such areas as bilingual education, 
intergroup relations, education fqr the disadvantaged, the handicapped and 
the gifted learner. No longer should all students be required to conform 
to a generalized program of instruction; rather, schools should develop 
inbtructional pro;;r..z:s cnat truly adapt on a continuing basis to Individual 
student needs. 

The goal of Consolidated Monitor and Review (f-AR) Services, in conjunction 
with the other phases of the Department's delivery system— local comprehen- 
sive program planning assisConce and consolidated application processing-- 
is CO assist districts to itnpierent cor::prehensive instructional progran^s 
vhich ceet niandated legal requlrcnients and, ir,ost inportantly, which 
promote naximum educational achievetrent by each student. 
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Naeds Assessment 
2*1 What tg 

2«l.lr The Departtaent of Education has traditionally administered 

specially , funded programs on an independent basis. Thus, each 
has required separate plans, regulations, grant applications, 

r 

Monitoring activities, and evaluation processes. This system 
, has resulted in duplication of effort, occasional conflicts 

o 

between programs, multiple field visits to the same sites, 
and extensive repetition of paper work, both by the Depart- 
vent staff and by LEAs, * 

2,1.2 Due primarily to the Department's independent system, LEAs 

have generally planned and iotplemented specially funded programs 
on a piecemeal basis. They have been required to submit separate 
reports, participate in reviews by staff from separate programs* 
and rely on independently administered technical services. 
Tri'^se activities have resulted in the development of multiple 
projects that should be closely related but, In fact, are often 
^ in^plementcd in isolation from each other. Inevitably, this 
fragmented approach tends not to focus on comprehensive needs 
of individual students. 

2*1.3 The Departzient * s independent system of administering 

specially funded programs has often required each program's 
limited staff to direct their monitoring efforts toward compliance 
with legal requirements and mlnitninn project standards. Often 
done on a relatively eub'jective basis, these kinds of reviews 
tend to highlight program veaknesseti and thus do little to 
generate cffort5i to improve t!»e Quality of individual projects, 
or to create a comprehensive school program^^^^ 



What Should Be ^ 

2 •2*1 The Department of Education should establish a consolidated 

/ 

Mnltor and review system for all specially fuaded prograns 
administered by the Department* Such a system will consolidate 
sdmlnistratlon of the various specially funded programs so 
that all monitor and review services are provided by a single' 
integrated unit. Integrated admlalstration will eliminate the 
duplication of paper work> the need for multiple field visits, . 
and the occasional conflicting directions that occur when each 
program is administered separately* With a funotionally orien** 
ted administrative system, specially trained staff will be able 
to conduct more objective systematic reviews in a more efficient 
manner* 

2*2.2 A Consolldcted Monitor and Review system will encourage 
to implcnent specially funded projects on a compre- 
hensive basis* Consolidated ilonitor and^Review services will 
requlrq LEA6 to focus on their total program by providing 

y 

conprehensive reviews that stress the need for Integrated 

c 

^ prograns which meet the broad range of students' needs. As 

well, consolidated n^views will examine many dimensions or 
project accomplishment, thereby adding to the formal student 
achievement data now collected. Such assessment will be done 
cooperatively, emphasizing LEA participation in a careful 
examination of their own strengths and weaknesses* Such a 
strategy should encourage sincere program improvement efforts. 

2.2*3 A Consolidated Monitor and Review system with a capable 
full-time staff will be equipped to emphasize program 
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strengths and prosram lr:prov€Tnents* While compliance 
with l#5gal requirements must be ascertained, this mandated 
function will be kept in proper perspective* The najor 
focus will be directed toward giving recognition to innovation 
and imagination and promoting a connon pursuit of successful 
comprehensive programs that result in superior levels of 
^ student achievement. 
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3,0 Objectives 
3-1 1973>74 

3, 1.1 By February 1974 the Department will establish a MAR 

system, including a consolidated MAR instrument (M-127), 
to be used to review all specially funded program- 

O ^ ^ included in the consolidated application. 

J 3.1.2 In addition, by February 1974 auxiliary instruments will 
be prepared to be used for review pf selected specially " 
funded prqgrams not presently included in the consolidate|d^ 
application. ^ 

3.1.3 By February 1974 the Department will establish a complaint 
procedures unit within the MAR structure which will respond, 
when appropriate, to citizen complaints, USOE audits, 

f GAO audits, and legal suits. 

3.1.4 By July 1974 two MAR teams including staff from coanty 
education offices, using the consolidated M-127 instrument 
and auxiliary instruments, will review specially funded 
programs in twenty districts (or multi-district cooperatives) 
interested in participating on a voluntary pilot basis. 

3.1.5 By July 1974 the Department, with assistance from 
participating'LEAs, will develop a system for identifying 
promising practices resulting from the planning for and 

implementation' or comprehensive programs. 

'« / 

3.2 197A-75 " (j 

3.2.1 By September 1974 the Department will revise and distribute 
the M-127 instrument, including instructions for self- 
assessment, to all districts vhich administer programs 
specially funded by the rc-^-^irtment . 

-4 on 



3«2.2 During fiscal yeer 1974-75, the Department, utilizing 

consolidated progran regulations and instructions, vlll 
monitor and review, in one*thilrd of those districts 
submitting consolidated applications, the implementation 
of activities as desigoea Icf the dlstrictn' comprehensive 
program plans and consolidated applications* 

3*2,3 During fiscal year 1974-75, the MAR unit will identify 
the most promising program practices selected through 
the on-'ilte HSR procedures. 

% 
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4*0 Implementation Desi<^nt 1973-^74 - Outline 

4.1 Prepare KAR instrtsnent 

4.1.1 Staffing 

Establish Departmental Advisory Group (Department-vide) 

Select planning team 

Identify county office assistance 

4.1.2 Operational Steps 
Review existing models 
Analyze legal elements 

* Review legislation; Education Code; Title 5 

* Discussion with program managers 
E9tablish complete MAR procedures 

Design Consolidated MAR Instrument (M-127) 

4.2 Initiate Pilot VAR ^ 



4.2-1 Staffing 

Establish liAK administration relationshios 
Select team leaders \ 
Select tvo pilot MAR teams 
Request county office assistance 
Select Complaint Response Unit 

4*2*2 Operational Steos 

Select twenty programs 

Plan and conduct inservice training program 
Conduct MAR activity in each program 

• Notify district 

- Advance planning 

• Conduct on-site review 
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^ - Prepare reports 

• Identify procolsing practices 
. Evaluate pilot effort 



/ \ 
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4.0 law^etneotatlon Desti^o - 1973»7A 

prepare Procedures and Instrumenti 

The first task in fulfilling the objectives for 1973-74 and 1974-75 
is to prepare the necessary instrument for iaplcmenting the consolidated 
reviewing process. The instrument; must be simple yet comprehensive. 
A comprehensive document is necessary because a wide variety of programs 
oust be reviewed in a consolidated manner* Simplicity is necessary 
because of the extensive number of people who must interpret and 
implement the design using a common approach and representing the 
total Department* 

The instrument must focus on basically three themes; i.e*, legal 
compliance, congruence with Objectives, and positive reinforcement* 
K\R will not be a police unit. Legal mandates will be an integral 
part of the process, but the paramount emphasis will be upon finding 
vhat works. 
4.1.1 Staffin^^ 

F.^tnbllsh p-^Tsartnental Advisory Group (Departirent-'wide ) 
A procedure which reviews the work of many units within 
the Department, makes recoinnendations concerning their 
program icipleoentat lont and makes demands upon personnel 
froai throughout the Department, should provide for input in a 
participatory manner* Such input is necessary to gain 
insights, insure a comoon approach, and achieve true support* 

Tho Advisory Croup should Include the Chief Deputy, the 
EPA, the three ni^e-^tpcin m^mngcrtJ, (lupport ualt man^^gers, 
one of the. Regional Service Team leaders. The i^rouo would > 
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provide suggestions to the Associate Superintendent 
responsible for MAR. Specific input would include 
* mar's Role in the total delivery- system, the inter** 
relationship with Compreheiisive Planning and the 

» 

Regional Service Teams, and the identification of areas 
to be reviewed during SDE visits to LEA projects, ptis 
group will meet once during December and once during 
January, make recommendations and disband* The 
Associate Superintendent will consider these xecommen** 
dations and incorporate them into the delivery system. 

Select Planninc> Team 

The Associate Superintendent responsible for MAR shall 
nominate the ad hoc Departmental planning team co'nsis* 
ting pf professional staff members from the following 
-.units: 

Cozir>ensatory Education 3 
,^ Office of Pro;:ram Evaluation 1 

i Secondary /Adult Education 2 

Dviring the month's of December and January this ad hoc 

tea^ will reoort to the Associate Supei^jLntendent for 

MAR.' Wprking with county office representative (see 

below), the planning team wlJ^l be responsible for 

'developing ,the MAR instrument, operating procedures, and 

the inscrvice training program. Tiae constraints after 

January 31 will be determined based on the team's progress 

in completing the MAR instrument and subsequent pilot 

requirements . 
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Identify County Office Assistance 
The Monitor and Review brocess has s direct impact 
on schools » districts and County Offices of Education. 
It is an extremely sensitive activity. To avoid mis* 
understanding and potential conflict, the MAR system 
must h^ve early involvement and full participation 
from these groups in order to insure mutual agreement 
regarding MAR procedures and instruments as well as a 
complete understanding of purposes and methodology. 
A representative group of county office staff, familiar 
with specially funded projects, will be selected to 
provide assistance during the MAR planning process. 
This group will meet with the Depa^ment MAR planning 
staff to review and make recommendations for developing 
MAR procedures and the MAR instrument. As well, the 
proposed MAR system will be presented to various 
educational groups for their suggestions and revisions. 
,1,2 Operational Steps 

Review Existin^g Models 

The planning team will review all existing, separate MAR 
efforts. These models will be reviewed in relation to 
their quality and will serve as resource documents for 
designing the Consolidated MAR Instrument (M-127). 
Analyze Legal Etetnents 

Each specially funded program has a limited number of 
federal and state (Title 5) requirements which must be 
met in order to -asrertain whether programs axe being • 
administered in accordance with the law. 
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ThMe requirements tend to be £a\ less than program guide-, 
lines have typically required. However, this quintessence 
of legal requirements must be identified for each program 
and included in the MAR instrumentations design. In 
essence, one might summarize thitf kind of requirement's 
a« LEA action or omission which would result in an audit 
exception* ' 

In addition to these fundamental, limited requirements, 
the planning team will include the newly designed program 
requirements resulting from the- Comprehensive Program 
Planning processes, 

These requirements will be ascertained by reviewing the 
law. obtaining inout from each program manager, and 
requesting new requirements from the Associate Superintend 
dent responsible for comprehensive Planning. No additional 
requirements, beyond these sources, will be included as 
part of the MAR compliance process. 
Establish Complete MAR procedures 

The planning team will assist the Program Manager and MAR • 
Administrator in establishing complete MAR procedures. 

m 

These procedures will include the use of regional teams 
and their functions, the establishment of a complaint 
procedures unit and procedures for responding to complaint£ 

In addition to the general areas indicated above, the 
planning team will delineate specific procedures such as 

1S7 
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preparatljbn of budget, scheduling, manloading, methods of 
coivclucting on-site visits, preparation of reports, and 
identification of promising practices. 

A final element of MAR will include procedures for interaction 
between MAR teams and Regional Service Teams. It will be 
essential that coordinating mechanisims be established on a 
formal basis* 

Design Consolidated MAR instrument (M*127) 
The M-127 Instrument will be designed as a truly consoll- 
dated "^instrument and will be compatible wlthlthe compre- 
hensive planning and consolidated application activities. 
Since the major|.ty of special program funds are included 
- in the consolidated a^Jplication, the consolidated MAR 
Instrument will focus pn those programs in order to insure 
a complete Department delivery system. 

Although the monitor and review services will focus on the 
consolidated program during fiscal years 1973-74 and 1974-75, 
the instrument, in order to meet Departmental MAR require- 
ments, will include subsets for other specially funded 
programs for which the Department has monitoring and review 
responsibility, ihese subsets will be a part of the MAR 
services in 1974-75* 
4.2 Initiate Pilot MAR 

Consolidated M,\R is part of the new Departmental delivery system 
and is a dramatic departure from the historical experience of 
fragr^icntcd and separate review procedures,' This kind of subatan- 
O • tlvc chnn-e must be Implemented only after pilot 
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instruments and the procedures • Thus, this plan calls for a 
pilot effort during 1973-74, with complete delivery in 1974-75. 

Because monitor and review activities can be extremely sensitive, 
surprises must' be eliminated. Some minimal testing is. essential 

in order to prepare a complete, viable instrument and establish 

J* 

workable procedures for use in all districts in California. 
Pilot testing will insure a high quality package representing 
strong leadership. Simultaneously, a pilot effort will enable 
the Department to partially fulfill its current responsibility to 
monitor and review programs already underway this year. 
A. 2.1 Staffing 

Establish MAR .Adinlnisfration Relationships 
KAR activities will represent a major part of the Depart- 
ment's delivery system and will require intensive management 
The Associate Superintendent responsible for MAR will be 
assisted by a MAR administrator who will be responsible 
for the ongoing operational processes. 

The MAR Program Manager and MAR Administrator will work 
closely together in order to insure a smooth, well coor- 
dinated delivery system. The MAR Administrator will 
report directly to the Associate Superintendent responsi- 
ble for MAR activities. 

The MAR Administrator will be responsible for the implemen- 
tation of M;\R procedures. His responsibility will Include 
buds^et recommendations, scheduling, regional workshops, and 

1S9 



' identification of promising practices found in schools 
being reviewed. Re will Slso review all final written 
MAR reports prepared by MAR teams. 

The MAR Administrator will make recommendations to the MAR 
Program Manager regs^rding conflict resblutlon; submission 
of final reports to districts and presentations to the 
Superintendent and Cabinet* 

Select Team Leaders 

For fiscal year 1973-74, two pilot team leaders will be 
selected by the Associate Superintendent for MAR and the 
MAR Administrator. These t^am leaders will lead pilot 
MAR teams from f!ebruary to June, and assist in the forma* 
tive evaluation of the M-127. Team leaders will work 
directly under the supervision of the MAR Administrator. 



Select TVo Pilot MAR Teams 

Two teams, composed of SDE and county office staff, will 
work under the supervision of the team leaders. Team size 
will vary according to the size and scope of a district's 
program (See Appendix III - Workload and Staffing). 

Personnel from programs not included in the A-127 (consoJLi* 
dated application) but which have a monitoring requirement 
will be added ns needed. A strong effort will be made to 
incorporate MAR responsibilities of these units as subsets 
of the reviews. Thus, when Consolidated MARs are^conductcd, 
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findings and recocmendations concerning these programs will 
be Included in the exit Interview and the overall reports 
This procedure will enable the Departoent to provide 
leadership to districts, encouraging btoad coordination 
of specially funded programs. 

Request County Office Assistance 

This HAR design recognizes and believes in the need for 
county office consultants to assist the State Department of 
Education in the responsibility to review programs and to 
find promising practices. As will be described in detail 
in the plan for full MAR ituplcinentation, the MAR program 
must have staff assistance from county offices. Thus, the 
MAR teams will be composed of SDE and county office consul* 
tants during MAR visits to those large districts which 
volunteer to participate in the pilot effort. The purposes 
for cooperative assistance are' fivefold: 

(1) Such supplementary staff will enable the MAR 
program to actually conduct visits in 251 of 
each district's schools; 

(2) The MAR program will be strengthened by utiliz- 
ing educational leaders as part of the MAR effort; 

(3) The Department's field relationship should be 
©ore closely knit by demonstrating our interest 
in working with county offices in a Joint effort 
to iir.prove the quality of comprehensive educa- 
tional programs; 

County office staff will bo provided, tho oppor- 

201 



tunity to Jointly identify promising practices 
and vill be a part of the Departtnent 'a disaemina** 
tlon ayatera; and 
(5) Although the Department might attempt to conduct 
this effort vith its own resources, the Depart^ 
ment does not wish to promote a centralized 
bureaucracy • 



Select Complaint Reafoonse Unit 

o 

> 

By February 1974, a complaint response procedure unit within 

1 

the MAR structure will be estajblished. This unit will 



respond, when appropriate, to 



titizen complaints, OE audits. 



GAO audits, and legal suits. /A procedure will be esta-» 

% 

blished to assure objectivity and standards for data 
collection and reporting. 
4.2.2 Operational Steps 

Select Twenty Consolidated Proi^rams to be Reviewed 
Given the fact that the instrument and the procedures must 
be field tested prior to statewide implementation, it is 
imperative that several consolidated programs be reviewed 
during FY 1973-74. {Secondly, initiating a monitor and 
review e^ort during the year will immediately demonstrate 
the Department's cotnaitr.ent to a complete delivery system 
by meeting its responsibility in this area. 

Twenty consolidated proi^rams will be reviewed by the two 
pilot tearis, each with the cnnnbillty to conduct ten complete 
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reviews In the February* June period. Each tees will begin 
operations in lace February 1974 conducting three reviews 
in Harch,^ April, and May and one in June. 

The twenty consolidated progreme will represent a crost 
section of the kinds of districts to be. served* Smelly 
intermediate c.ad Urge districts will be Included. Urban, 
suburban, and rural wil4r be considered as other factors. . 
An attempt will also 5e nad^ to test the MAR procedures 
in cooperative programs. Thierefore, the number of actual 
districts will extend beyond ^enty« 
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Plan and Conduct Inservice^Tralning Program 
The planning team will plan and coi^ct an inservice 
training program for all members of the pilot MAR teams. 
This program, to bz presented in February, will cover the 
general approach for consolidated MAR visits, emphasizing 
the cooperative, positive focus and our concern for pro- 
mo ting program improvement rather than pointing out 
program weaknesses. * In addition, detailed information 
regarding the lavs and regulations and specific MAR 
procedures will be presented and discussed in depth. 



The objective of the inservice effcrtj/ill be to establish 
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close working relationships among team members^ insure 
complete familiarirty with procedures^ and especially during 
the pilot MAR, footer a climate that encoorages jconstructive 
criticism^ allowing for reviaion of MAR procedures that, are 
found inadequate. Because the need for total team integrity 
is so great all county office representatives in the pilot 
MAR must participate in this inservlce program, even if they 
will not^ Join a MAR team until some later point (i.ml^ as 
an altei^ate^er additional consultant who would participate 
in visits to very large districts). 

Conduct MAR Acttvttv in £ach of 20 Districts 
The MAR process in each district will be similar (see 
Appendix V for a detailed schedule). In general, there 
are four broad areas to be monitored during the course of 
an on*site visit: 

f (1) Compliance of program with federal and state 
regulations (see detailed categories in 
Appendix ifl). 
(2) Status of documents that support^^i;onsolidated 
application; i.e., those which are reqiiired to 
be on file in th-* district or in individual ' 
schools. ^ 

Congruence between program objectives as des* 
cribed in comprehensive plans and implementation 
activities. 

(4) Identification of promising practices* ^ 
Each pilot >JAR visit will involve .notification to diiTtrtcts, 



Advanced planning*. on«-8lte visits (including a structured 
exit interyiev). preparation of final written reports, and 
identification. of promising practices. During the pilot 
MAR period, districts will not receive the MAR instrument 
in advance since it will be revised periodically. However, 
all districts will reteive the MAR instrument once the full 
MAR program is implemented. This procedure is designed to 
encourage all districts to conduct a structured self -assess 
ment whether or not they Tiive an on-slte.i*lAR team visit 
that year. . 

Evaluate Pilot Effort \ 

^e formative and sumnative evaluation of the pilot effort 
^or 1973-74 represents an absolutely ^ssenti^l phase. A 
thorough evaluation of the instrument and the pilot imple- 
mentation procedures must be made before the system"^ 
introduced Co school districts. Difficultlea in the 
5iystcm should be identified and resulting changes should 
be m^de prior to |leld work. . 
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MAR represents a very sensinve effort which can be mis- 
interpt)eted or feared by school districts. Departmental 
staff must provide very positive leadership, well tested 
procedures and comprehensive instruments when conducting 
on-site visits. ^ ^ » 

PunR^tlve evaluation during the pilot visits will provide 
ongoing Improvenient of the systen/. The evaluation will 
als^ provide feedback to staff members concerning what 



Bodlflcatlofis muscle made Id the consolidated Inttnuneot 
In order for the «el^*asse8Si!i€Qt procedutes to be IvpleiDefi* 
ted*'em8lly by ell districts, not Just by those which also 
vltl be visited by e MAR team. 
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5.0 loplecientaCton Oesir.nt 1974*75 - Outlinfe 
5.1 Prepare for Full MAR' laplenentation 
5.1.1 Staffing , 

Select core staff fot six teaxcs 
Identify county dfflce assistance 
$tl«^ Operational Seeps 

Revise llAR procedure and instruments as needed 
Establish administration logistics and scheduling procedure 
Establish in*house support work flow and materi^ln flov 
Conduct inservice training 
5«2 Initiate Contacts With Districts 
5.2.1 Staffing 

MAR teams « already assembled 
5«2«2 Operational Steps 

Send to each district the MAR Self -Assessment instrument 
Conduct Regional vorlu^ops explaining M-127 and MAR procedures 
5.3 Conduct MAR Visits (180) 
5.3*1 Staffing 

Core MAR Teams and county office representatives 
5.3«2 Operational Steps 

Select 1/3 of total number of programs to be monitored 
Schedule and conduct MAR activity In each program 

- Notify district ' 
« Advance planning 

• Conduct on-site review 

- Prepare reports 

• Identify pron^ising practices 

er|c 
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5,0 Implementation Design: 1974-75 

5,1 Prepare for Full MAR Iroplementation 
5.1.1 Staffing ^ 

Select Core Staff for Six MAR Teams 

MAR will be organized to coapleoBnt the activities of the 
six Regional Service Teams. Thus six MAR teams will also 
be formed for the MAR effort and each will have the same 
^ regional assignment as the corresponding RST* 

.-t 

Each team will have a permanent team leader resiponsible to 
the MAR administrator and. to the Associate Superintendent 
responsible for MAR, Each team will have a core staff of 
three SDE consultants. The number of county staff joining 
the core team will vary depending on the nature of the 
particular region or the nature of a particular school 
district; i.e., the teams will be enlarged when conducting 
MAR visits to programs with substaotially greater numbers 
^ of personnel, schools and students. Because team size 

will vary, it is expected that seme staff may be assigned 
to different t/sams depending on the nature of districts , 
scheduled for MAR visits. Clearly, a modular approach 
desirable so that tearas can function, in a flexible fashion. 
Identify County Office Assistance for Full MAR / 
This proposed MAR program represents a truly unique approach 
for cooperative services by the State Deoarttnent of Educa- 
tion and county offices; This MAR system is deliberately 
dcBir.ncc! to include county office assistance, nr'ovided on 
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« voluntary basis. 

There are. a number of important considerations which support 
this aspect of the proposal. First, the cooperative effort 
o£ SDE anrf county staff will help make the Monitor and 
Review prograa more objective since staff from each will 
bring different perspectives to the MAR teams. Second, the 
county office staff will have direct Involvement in a 
major program activity of the Department, adding expertise 
and experience at a more local level. Third, by increasing • 
the size of each team, the MAR program will Increase its 
capability to make on-site school visits, insuring a more 
comprehensive monitor and review system. Fourth, by work- 

! 
( 

Ing together, SDE and county office staff should develop 
a broader understanding and mutual respect for each other's 
✓ functions in and .contributions to California's educational 

system. 

i ' / 

' Based on workload and staffing assumptions, it is proposed 

that 18 consoltant positions be requested for participation 
in the MAR program* With teams of six, each MAR visit will 
Include on-site teviews of up to six participating schools 
(more in the very largest districts where the total visit 
time will be longer). 

/ 
* 

The participation oi county office staff must of course 
depend on the wllHngness of county* superintendents to 

csji^a litaif to t\\iu (Jifort. ou:>cJ on initial contacts ^ 
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and discussions, it is anticipated that these consultants 
can be inade available on a flexible, rotating basis. 
5.1.2 Operational Steps 

Revise MAR Procedures and Instruments 

The evaluation of the pilot MAR should produce recoomenda* 
tions relating to the MAR procedures as they are implemented. 

V 

These recommended , changes will be incorporated in the revised 
^^rocedure as it is developed for the implementation of ^ the 
full MAR. The effectiveness and efficiency of the MAR 
^instruments also will be assessed as a part of the cvalua* 
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of the pilot MAR activities. The instruments will be 
modified in accordance with the evaluation findings and 
revised forms prepared for the full MAR activities. 
Establish Adn^inistrative Logistics and Scheduling Procedure 
The operational |[>r6cedures for discharging all administra* 
tive tasks will be developed. Topics such as conducting 
orientation and traininjg meetings, determining appropriate 
team size per program, team assignments, identification, 
duplication and distribution of necessary documents, and 
the procedure for processing, reporting and filing the 
HAR reports, will be addressed in^ this phase. A systematic 
procedure for scheduling field visits to assure optimum 
utilization of the ayailable manpower within the framework 
of the total commitment, will be developed. A master schedule 
will be developed and maintained • 



pnyp" \ phaaca will be sequenced and re«ponsii >iiities assigned. 
» # 



\ • Estnblifqh Tn-Hou-.e Snnoort Work Flov and Material Flow 

, ' — 

\ Once the procedures and required materials that are needed 

\ ., • . 

f or, ceaauct.ing iUX visits are determined, the steps and 



A work and materials flow chart and process check sheets 

s 

will then be developed. Process control charts for each 

■ ..:..-! 

region will be prepared also. The status of a MAR for any 
^ " given district or group of districts can then be determined 

vithout delay at\d a record of progress is always available. 
Conduct In-service Training ^ ' 

Staff will receive training regarding all phases of the \ 
MAR effort, including related areas such as the comprehen* 
^ ^ sive planning and consolidated application procedures 

implemented by the TAT teams. They will receive briefings 

« 

on the basic legal requirements of each program included 
in the delivery system; they will participate in the final 
review of the MAR instnxment, and develop criteria for 
^ analyzing '^planning products** produced by schools and 

districts. The MAR staff will also receive training in 

✓ 

the identification of promising practices. Most importantly, 
training will focus on conducting a positive monitor and 
review, stressing the need to assist LEAs to identify 
their own problems and areas needing improvement and to 
reinforce programs that are already operating effectively. 

This kind of training must involve building of tesm 

\ 

identity, mutual trust and confidence* ^ » 

5.2 Initiate Contact with All Districts 

5.2.1 Staffing 

At this point KAR teans will have been already assembled. 

5.2.2 0.pcrntl3njl Stcgs 

Snri C'At Sf>lf -\«;«trr>r> r^nt T".*:tru-^ ^ nt to All Dlnt 'icts 
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Inctniaent (M-127 A)* This instruaent vlll b« Identical to 
the instruments used by the teatns. However, It will Include 
instructions needed to clarify usage of the instruments* This 
procedure will bo followed In order to eliminate surprises and 

minimize fear or antagonlsa. Th^ docuaent is sieant to 
identify basic legal requirements and essential comprehensive 
program planning components while emphasizing our desire to 
promote program Improvement, There will be no hidden agenda 
since districts should be able to use t^e MM( documents to 
fulfill the goals of the consolidated delivery system. 
District representatives will have participated In planning the 
instrument and will be fully Infdrm^d concerning Its program 
details. 

Conduct Regional Workshops Explaining M-127 and MAR Procedures 
The self-ascefisment instruseat (H-127 A) will be designed to 
proaote widespread program Inprovetaent. If used actlveljr^ 
all districts, the ^^AR process should insure total statewide 
coverage. 

Workshops are scheduled to describe the goals of self^assess- 
went, using M-127 A. These workshops will actually serve as 
' inscrvice training In self-assessment for district staff and 

will be especially Important for those districts not to be 
visited during 1974-75. The workshops will reinforce the need 
for well prepared comprehensive planning products for district 
which will be visited in 197A-75. 

Cond uct MAR Visits 

5.3.1 Staffing 

As noted above, K^R staff will be assigned regions based upon 



the workload reflected in Appendix ill. There will likely 
be flexible assignments of staff based upon the ratio of 
one extra professional educator for each four schools *above^ 
^ and beyond each core MAR team's capability. 

5.3.2 Operational Steps 

Based upon experiences gained in the 1973*74 pilot effort ^ 
the MAR unit will conduct approximately 180 separate reviews* 
The specific steps involved in each MAR visit are the Same 
as the operational steps delineated for 1973«74« 

g The 1974*75 teams will be operating with complete rather than 
experimental instrument's and procedures. Each team will 
have full authority to present their f indings^ to the district 
during the exit interviews. Their final reports should 
closely reflect these on*site interviews. 

f 
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6,0 Organizational Relatlonahlog 

6*1 Regional Servlee Teams - MAR Interaction 
6«1.1 General liaison 

6.1.2 Use of RST staff in the MAR program 
6*2 ECE Management Team • MAR Interaction 

6.2.1 General liaison 

6.2.2 Use of ECE*MAR staff In the KAR program 
6.3 Office of Evaluation « MAR Interaction 

6.3«1 General liaison 

6.3.2 Use of Office of Evaluation staff in the MAR program 



\ 

\ 
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CONSOUEATED HONITo/aND REVIEW SERVICES 

6.0 Organizational Relationships 

The new delivery system has been established to coordinate the Department's 
administration of categorically funded programs, especially those related 
to early chil(^hood education. The preceding sections describe how the 

y 

State Department of Education proposes to implement the third major 
component of the delivery system, monitor and review of comprehensive 
education programs developed by local education agencies. This section 
describes how Monitor and Review Services will interface with other 
delivery system. components and related Office of Evaluation activities. 

It should be pointed out that MAR has a specific purpose in the delivery 
system. It can only serve a diagnostic assessment function; identifying 
areas requiring pro9;ram improvement by an LEA. The necessary assistance 
must be provided by some other units depending on the nature*^ of the 
problem. To have this haopen, it will be the resoonsibility of the MAR 
teams, MnR administrator, and MAR program manager to insure communica- 
tion initiated, whether with Regional Service Teams, with the Office of 
Evaluation, with the Management Assistance Team, or with appropriate 
subject natter specialists - whoever is most likely to have the skills 
needed by the district. Similarly, if a district's program appears par- 
ticularly promising, subject-matter units will be asked to make special 
reviews to confirm this assessment and to prepare appropriate descriptive 
material for systematic dissemination. 

6 A Regional Service Teams - KAR Interaction 
6.1.1 General liaison 
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It is proposed that six MAR teams be established. This number 
corresponds to the K3T structure thereby promoting stable 
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working relationships bctvcen two teaiRS assigned to a geo- 
graphical region. It will be essential that the two groups 
perform their duties in a coordinated manner. 

In order to maintain close liaison, it is proposed that the 
MAR team and a member (s) of the Regional Service Team would 
review the district's programs prior to the visit to that 
school district. The details of this review will be developed 
together. They could be accomplished on a monthly basis or 
more frequently if felt necessary. Similarly, a copy of 
individual MAR reports describing ea^ district visit and a 
debriefing (if needed) will be provided to the RST« In 
addition to this collaboration, when any policy questions 
arise related to a visit, the MAR Administrator, Consolidated 
Application Administrator and leaders of both regional teams 

will r *et to detennine what orooiems exist in the LEA prograiq 
and what steps are needed to resolve thexo. This type of 
^coordination will eliminate the possibility of multiple » 
possibly conflicting, instructions being Riven to a school 
district by the two teams. 

It should be added that the two teams, while operating in the 
field simultaneously during the January-May period, will have 
very different responsibilities. The MAR team will be 
monitoring a district's implementation of their educational 
program (approved by the Board of Education the previous June)' 
while the RST will be assisting the district with their next 



year's pUn and appropriate application for funda. Katurallyt 
coordination of visit schedules Will be maintained so that 
*both teams are noc in the saae district at the sane time. 
Folloving these procedures, the tcaas Will provide compleaen- 
tary services • • ^ 

In addition, during the pilot phase of MAR, the MAR Program 
Ma^ager^ MAR Administrator, and MAR team leaders will meet 
irith equivalent RST personnel to assure full coordination. 
As mentioned above, the MAR teams should meet with the appro- 
priate RST prior to visiting each district. 

Use of RST staff in the MAR Progratn 

Tne cctiiprehensive planning and consolidated application 
processing activities require intensive services to districts 
during the January- Junp period each year. In addition, between 
July and December maintenance functions will be continuea. 
However, it is anticipated that some staff who served with 
Regional Service Teataa could be available to participate in 
the MAR program during the October-December period. Their 
participation would serve three important purposes: 

1. The MAR^teams will be enlarged, thus allowing direct 
visits to a greater number of schools in the largest 
districts. 

2. RST members wiU have a chance to participate in the 
MAR process, thus viewing first hand how the MAR 
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coBponent conpLeMncs the RSX efforts to assist 

districts in pUtming and implesenting comprehensive 

educational prograaa* 
3. EST ataff participatioo will better iMura coatinuity 

between the conprehentive planning/consolidated applica- 
7-*lon phases and the MAR phase of the delivery system. 
It is proposed that 12 consultants vith RST experience be 
assigned for full-time service to the MAR regional teams ba- 
tveen October and December * These vould be selected once the 
workload of each RST has been determined.* These members vould 
participate in the inservice training program with the core • 
SDK and county office MAR team members* 

6.2 Early Childhood Education Management Team - MA R Interaction 
6e2.1 Genera i; liaison 

The ECE Management Team is responsible for implementing 
cotaprehensivc ECE programs in participatini; schools throughout 
California. Since thi3 responsibility includes monitor and 
review services as well as application processing, it will be 
necessary for the consolidated MAR program to establish formal 
relationships with the ECK Management Team. 

It is proposed that the ECE Management Team retain responsi* 
bility for monitor and review of those schools receiving ECE 
funds, for several reasons: ECE funds arc awarded on a 
competitive basis and tfchooL participation is determined 
according to the dittrict^s master plan and the success of 
^ individual schools in competing tor expansion lunds. It is 
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imporCant to note that this coapetition is on a school«by- . 
school bssl3, thus the nonitor and revlev procedures re<^uire 
school tevel assessment, not districtnide assessment. In 
addition, the ECE rev^^ will only cover grades K-3 (or K*l/K-2 

in some schools) , while other programs will include all grade 
levels in the same schools « As a r^sul^t, the ECE MAR procedures 
and scope will be very different than fhose required for the 
consolidated MAR program. 

To be sure tliat' iflstricts have a clear utiders tending of these 
two similar functions', the consolidated MAR program will 
include a carefu,! explanation describing just what relationships 
exist and how the department has divi^ded its MAR responsibili* 
tie& To avoid 'dCfpIicacion of effcrt and possible misux^derstand* 
ing, the consolidated HAR, program will not include visits* to 
Qost of the scnools being itlonitored by the ECE Management 
^ Team. In single-^school districts, the MAR staff wij.! not 

, revisit grades which were visited by ECE-MAR staff. 

Following the initial year of consolidated MAR implementation 
(FY 1974-75), it is proposed that a comprehensive rcviw be 
conductedlto determine whether these two monitor and review 
activities should be merged in some way for FY 1975-76* 

6.2.2 Use of ECIi: VAR staff in the Conr;olidated I'AK Pro^^ram 

The ECE MAR activity requires intensive staff assistance during 
the December-March period (approximately 24 consultants). 
^ During ,ti\e ApriI-;Uy period, CCi^V^^n^ indicate that IS 
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coMttUants will be required, thut the reMi:)lng staff, •••igned 
to the ECE Management Team on a part-tine basis should be 
available to participate In the consolidated MA^ program. At 
Is the case with RST members, there are excellent reasons £or 

this participation: . 

1\ Ihe ECB staff will have substantial monitor and review 
experience. The need ^or additional training ii! 
consolidated MAR procedureslwill.be ninimized. 

2. The ECE staff, baaed on their exposure to conprehensive 

•ft 

y planning and impleiaentation of ECE programs, will have 

valuable inputs for districts and schools whose programs 
are less well developed. 

3. Enlarged nonitor and review teacs will permit visits to 
a greater number^ participating schools in large 
districts. 

It is thus proposed that I staff cember with ECE KAR experience 
be assigned to each consolidated MAR regional team (a total of 
six consultants) during the tnonths of April and May. 
6.3 Office of EvaluaCion - ILMl Interaction 

1 

6.3.1 General liaisofi 

Although the monitor and review functions differ substantially 
from evaluation function^, it is likely that some confusion 
may result in districts especially since the delivery system 
has created many changes in the Department's operations. 
Therefore, it will^be necessary to define precis*^ the areas 

of responsibility to be assumed by the MAR program and by • 
the Office of Evaluation. 2*^0 



The l!AR Planning Team will review with the Office of 
Evaluation all MAR procedures and assesiiment criteria 
^ ralated to evaluation deaigns planned and Inplesentevt 
by dlatrlctt* In additlonj» information to the field 
vlll include a section describing che differing respon- 
sibillties. of each program and the nature of field 
operations having direct effect on school districts* 

* 

In moat cases, the MAR program will not have responal* 

bility for follov-up on-site visits that are recommended 

as a result of problems vith a particular district's 

program indicated by analysis of student achievement data 

prepared by the Office of Evaluation* This probably vill 

Involve a licited cumber of districts, but such capability 

is essential in order to cosply vith SDE evaluation respon*- 

sibllitles for each of the progranis funded throagh the ^ 

consolidated apj>licacions* 

6*3.2 Use of Oftfice of Evalua tion Staff in the Consolidated 

" ' ' ■ wp- 

MAR Pro-rata 

It 1^ proposed that one evaluation consultant participate . 
on a pencaneht full-*tlrae basis in the consolidated MAR progran* 
The evaluation consultant vill assist in preparing (or revlev- 
ing) procedures and materials related to legal requirements 
f^>r planning and it&pleaenting an appropriate program evalua* 
tion. In addition^ the consultant vill participate as needed 

' in MAR visits, adding specific expertise to that team and 

I ' 

brbadening Its depth of experience. Naturally, the consultant 
Q vill be available to all six MAR regional teams for advice and 

aaals tance « ^ 
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APPENDIX II 
FIELD SERVICE REGIONS 



Regtoa T (7ii 
(Northern) 
Del Norte 
Husboldt 
Laka 

MenSlocioo 
Butte 
Glenn 
Latten 

Modoc 
Plumas 
Shasta 
Siskiyou 
Tehama 
Trinity 
Marin 
Napa 
Sonoma • 



Iniperiai 
Orange 
Riverside 
San Diego 




Region VT (87) Region IV (99 ) 
(Southern) (South-Centra I) 



Inyo 
Kern 
Kings 

San Bernardino • 
San Luis Obispo 
Region II (99 ) Tulare 

(Central) * * Santa Barbara 



Alpine 
Amador 
Cr^lavetas 
Colusa 
El Dorado 
Fresno 
Madera 
Mariposa 
Merced 
Sacramento 
San Joaquin 
Mono 
Nevada 
Placer 
Sierra 
Sutter 
Yolo 

yaba 

Solano 
^^tanislatis 
Uumne 



Ventura 

Region III(103> 

(Bay Area) 
AUmeda 
Contra Costa 
Monterey 
* San Benito 
San Francisco 
San Msteo • 
Santa Clara 
Santa Cruz 

Region V (74 ) 
(Los Angeles) 
tos Angeles 



A. 



1> \ 
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CONSOLIOATED MAR SERVICES 
APPENDIX III 



Workload and Staffing 
!• Workload Standards 

A. Basic Assugptions : 

1. The tBonitor and review prograsi muat include visits to classrooms. 
Thus MAR visits can .only be made while schools are in session. If 
this assumption is valid, then 30 weeks are the maximum possible 
during which MAR visits can be conducted. 

2. The monitor and review program must include an assessment of the 
district's compliance with regulations involving comprehensive 
planning, instructional activities, community and parent involve- 
sient» fiscal management and program evaluation design. That is, 

the MAR program should be responsible for conducting a coroprehen- . | 
give program review . 

3. The Department of Education must maintain final responsibility for 
determining whether each district i^ complying with at least the 
minimum legal requirements as established by federal and state 
laws and regulations. 

B. Work load P^nuir^-^qnts (consequences of basic assa^notions) / 

1. The department receives approximately 530 corsolidated applications 
* via the new^ categorical assistance delivery system. For fiscal 
year 1973-74, the sizes of the grants were distributed as follows: 



0 - 50,000 78 

50 - 100,000 110 

100 - 150,000 68 

150 - 200,000 50 

200 • 250,000 27 

250 - 300,000 • 32 

300 - 350,000 ' 28 

350 - 400,000 21 

400 - 450,000 ' 15 

450 - 500,000 12 

500 - 550^000 16 

550 - 600,000 6 

600 - 650,000 V 5 

650 - 700,000 5 

700 - 750,000 6 

750 - 1,000,000 29 

1,000,000 Plus 25 

TOTAL 533 




2 



2. 



3. 



Ihe U.S.O.E. staff hat recoanended that programs of $500,000 or more 
be visited annually and that all districts bo r.onltored at least 
every two years, noting that only 22 reviews (usually made by 
Sttall teams and lasting^ l-»2 days) were completed by the SDE during 
the past 4 years. While, this would be optimal, we feel the oagni* 
tude of California's program makes this unrealistic* Instead we 
propose a varying frequency of visits as follows: 

Required No* of 

No> of Districts . Freouency Visits Annually 



$ Grant 

$50,000 or less 
$50,000 • 700,000 
$700,000 or more 



78 
395 

60 
53a 



Once/4 years 
Once/3 years 
Once/2 years 



19 
132 
30 

181 visits per yeai 



Although MAR visits to districts will vary in length and scope 
depending on the size of each district's comprehensive program, 
we estimate that the average time per visit - including time for 
advance preparation, on-site observation, analysis of information 
and final report compilation • will cover one week. Accepting the 
need for 181 visits each yiSar, each of the six MAR teams would be 
required to conduct one visit per week, or a total of 30 visits per 
school year'. (This requirement would vary slightly between regions.) 



II. Staffing 



A. Basic Asst!r?.r>ticns 



1. Six MAR teams are required, . one per field service region. 

2. State D^partnient consultants must retain responsibility for the 

luccersiiip cl c^ich L'^ua. 

3. County Office consultants will be available to oarticioate as 
members of cacn h:AR team, if cniy tor part-tir:!e service involving 
several different ir.cividuals throughout the year. 

4. SDE staff vith Kectional Service Team assicnz^ents (January - June) 
,and ECE-M-VR assi2r.n;ents (Uecer»oer - Harcn) will be available for 
assignment with *^Lv?. teanis troa October - Oeceaoer and April - June 
respectively . 

B. Staffing Requirements 

i 

1. State Dcpartrient Staff : 

6 permanent MAR teams x 3 consultants " IS 
Leader * 1 consultant 

Prof»,ram Ccnpliance - 1 consultant 
.Fiscal Cccipliance 'J^ consultant 
. ' 3 

1 Complaint Response Unit x 2 consultants » _2 

20 
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2 . County Ot flee Stnff 

6 MAR teaoc x 3 consultants 



18 



225 



Schedule for Use of Additional Sf ff 



During the periods noted above, ataff having part-time assignments 
%rlth the RSTs and ECE Management Team could be available to provide 
additional assistance to the consolidated MAR program. Their 
assistance would be invaluable » since the enlarged MAR teams would 
schedule visits to the 60 largest districts and cfonduct on-site 
reviews in a significantly greater number of schools: 



Districts receiving Number of 



$700,000 - $5,000,000 



Participating Schools 



56 



954 (average of 17) 



Districts receiving 
over $5,000,000 



Number of 
Participating Schools 



Compton ($7,085»818) 

Oakland ($9,190,344) 

San Francisco (11,821,486) 

Los Angeles ($67,017,904) 



18 

79 
81 
216 



226 
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APPENDIX IV 



KAR PROGRAM ° 
System Design 



Ti»e 
Frame 



System Definition 
end Development 



Product 



Dec. 1, 1973 



Function 



Define the basi* for 
KAR 

Define Goaly Needs and 
Related ObVectives 



(See report Part 1.0 and 2.0) 



Dec. I, 1973 



Dec. I, 1973 



Description 



Define MAR - (Report) 

General cescription 
Content requxremencs 
and limitations 



T 



Development 



3.0 Define development 

objectives and tine frarne 
4.0 Develop Inpiementation 



(See report Part 1.0 through 
4.0) 



(See report Part 3.0) 

(See Report Part ^.0 
and Flow Chart) 



(Flov Chart Attached) 
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MAR PROGRAM 
IvpletaentatloQ Design 

Flow Cnarc 



Phases 



4a 

Develop MAR 

Procedures 

and 

Instruments 
Dec. • Feb. 74 



4.2 

Initiate 
Pilot :i\R 

Dec. 73 - 
June 74 



4.0 * Impleraenf tion Desit^n 
^ 1S73 - 1974 



4U.I Staffing 




Establish Dept. Adv. 


Group 


Identify LEA Ass*t. 




Select Planning Team 


(Six) : 



4.1.2 Operational Steps 
' Review Models 

Analyze Legal Elei^nts 
Establish MAR Proeldures 
Design MAR Instrument <M*127) 



4.2.1 SI 



fins 



Define Kole of K\R Admiaistriator 
select Tt^o Pilot yAR Teaas - 

Five M^^^rs, Plus Leader - 

(Six K-:r.::Gr3 Eacn) 
Select Cccplainc Procedure 

Unit Within 'v*AR Structure 
Request LEA Assistance 



1 



4.2.2 Qoerationgi Stcns 

Select Twenty jt^rogrcms 
Schedule & Conduct M\R Activities 

- Notify District 

• Complete Advanced Planning 

- Conduct On-site Visit 

- Prepare Reports 

- Identify Promising Practices 
Evaluate Pilot Effort 



Target Dates 



u 
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APPENDIX IV 

S.O Itnpleoentation Design 
1974 - 75 



5.1 ' 

Prepare For 
Full KAR 
Implefoen* 
tation 



5.2 

Initiate 
Cont:icts . 
With All 
Districts 



5.1.1 Staffini? 




Select Staff 




Identify LEA Assistance 


\ 


* 



5.1.2 Operational Steos 

Revise K\R Procedures and 
Instruments as Needed 
Establish Administration Logis- 
tics & Scheduling Procedures 
* Establish In*Kouse Support 

Work Flow & Material Flow 
Conduct Inservice Training 



5.2. i . S tnriiu g 

VA?. Teans Plus LEA Assistance 



15.2.2 ^ 



Conduct Kec;ionax Workshoos 



5.3 

Conduct MAR 
Visits (160) 



5.3.1 



M\X Teams - Plus LEA 
Eepresencacives 



5.3.2 Oi^jracionai Sceu^s 

Select 1/3 of ictal Prograas 
Schedule Visits 
Conduct KAR Activities 
(Five Steos) 



APPENDIX V 
MAR PROCEDURE PIAW 

1.0 Pre*Plannipg 

!•! Utttr is sent to tjhe, .district to be visited icdicating dates for 
possible MAR viaitatidn and asking district to approve dates. 

1.2 Ihe MAR Coordinator working with Program Director schedules interviews 
for individual MAR teas meabers with progran pertonoel within the 
district to be visited. 

1.3 Materials are prepared for consultants 

• Material check list (Form M-3) 

- Assignaint sheet (Form M*4) 

- M-127 

• Report fom and instruction sheet (Form M*2) 

• On-site guide reference (MAR Ref . #4) 

- District sunsaary sheet (Fom M-1) 

• Other 

1.4. MAR Regional Coordinator reviews the purpose of MAR visit with the 
entire MAR team and appoints team captain for the visit and distri- 
butes materials * 

2.0 On>Site Visit 

2.1 MAR team meets as a group with the district staff to become oriented 

to the consolidated uro^r^ offered in the district. 

2.2 Individual team members conduct scheduled interviews. 

2.3 J-iR team meets as a group at the end of each day to ausnarize findings. 

2.4 ir.e evening; oaiore che exit presentation, the hriR learn drafts a report 
based on ^he findings. 

3.0 Exit ProcQntatlon 

3.1 The report is read to the district staff as an exit presentation on 
the last day of the visit. 

3.2 District personnel may submit comments for consideration in the report. 
4.0 Tina I >!AR Report 

4.1 The report is edited after MAR team returns to State Department of 
Education Office. 

4.2 The report is read and approved by the MAR Program Manager. 

4.3 After approximately one month from the date of the MAR visitation^ the 
district receives the report. 
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tm PROCEDURE FIAH 

4.4 District cay sub=:it a response to the !l\xw report indicating con- 
currence or lack ox concurrence vith the various xbnc ems identi* 
fled by the visiting MAR team. In the event that points of non* 
concurrence are cited, a review will be oade and the isaues discussed 
vitb the district. 

J 

4«5 The final report is sent to the district for their use and to the 
ft.S.T. and other agencies as required* 

5.0 Identify Proroising Practices 

S-.l As part of the district visit, MAR team makes request to visit the 
district's most exemplary program. 

5*2 Using program criteria determined in advance, conduct review of nominated 
prograo(5)« 

\ 

5.3 Collect descriptive materials already developed, if any. ^ 
^•4' Rate program using criteria 

5.5 -Review rating with district, discussing any additional input from 

administrators. 

5.6 Based on rating, include program in promising practices category for 
further review and possible inclusion in promising practices dissemina* 
tion suiteriai^* 
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APPENDIX D 



Monitor and Review In service 
Evaluation Report . 



Srr.L^::^ ]\]-^rvl'"rM cl* K;'i:c;^t 5 on 
' VjxrcU 12-15, 1974 



The ir- :vvfcc V'-^?iir.^. for I'-^ld llnrch 12-?*), \7n$ c-ttC!r:e<J by 47 county 

anu iili^t-" -^-irL : 'w- i ■ '.Ls . . i'O p".r^r>.s'j of tnc: ::\'iCi'vicc \-as to Gcquaint: the 
pc.rlj'. ,. ' ; i nt r-ni to onn'wlo llic T^articipaars to 

11^11^1: ilia iw-'^z:'- :M €.i cc'z L' 2ly in concMcli r..onifcr r.nd review scs- 
sior.iiX- ^'i-" ri^^lJ, i .1 tcHT f^-^-'i 'malysis, ti-i nr.»asi^i trout of tr.a objec- 
tive *»c t:'.:i >"'jr..-:r of ti'.j r^rnitor «^r:i vovlev ni-rion in tl'»c field 
a^, cvic'or.r^d by Chv. rcni-:Lion of r.cr.nol dir-trictr; in r.jotinj conplloi^te 
after the bnitor end veview nr^s occurred. 

x\]l cue ihrco rc.r.po.,rc:c cO ti:c: cvnluntioa i:istru-:onL 03 th-^sc rtlcr.djr.f, 
the Ir.r-t Cry -."cre r-\rcivecl. 'J 'n^se involvca circctly rh. prop.rnri f^ctivi- 
tios did net fill ovl cvaluctticr* icr-rr.s. i>s';i lu.'i ica \ both fbrr.inl nnd 
jr.for.ril. Ir.forr.. i c'Voiuacio:\ vas conductt c. turin.^; a I*icrvcen session'; 
by tlirc^- crr.erve:s \ :,o i:rcLe Lho responses received. xhe results are on 
pr.j;e 3 of repoic. 

Trch "fcirr.i^t vr'-. r^^^-on lr.nt:-.:r'jnt rnd ;J h^ch of roforonces 

vhich ir.ciu'.'^d t\l\ i.ie lev isic.c io::, ^'v i(!u 1 1 , or cti>*: i <.utliot'iiv fojc 
each iter. l:\ the ;.-]27. 



Srnall group reetings v:ere led by the follovang: 



hv. 








Iir. 


Vomer* 


o,:ro\ ;!3:.ber 














: r.rbcrr : ^ :. 






Dr. 


rrr.T:k 1.' 










r ^ , "/r \ ] r»'^r 






1'.; iccl: ;s:c'.. 




;vl Ilcserrch 


):r. 


Ale- Chin, : 


rLer;Tc ."-j 1 L lo*: 




* ' \- 


^r: Ti , 




^•v: c er 




. ].i ll he :' 


iiJOj L\5 trie 


t k«'prer'tjr:t iitivc 


• I V i 
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RESPc:,'r'.> TO Tii:: ihSi:rA'ici: - ■i.mning evaluation FcrvM 

The V'^'^t V-j-._cf_^^^^ 

No> Responding 



Going through the nonitoring docui:nent with ^ 
a spaciaiict in the field • 

Small group discussions . . • 

Knowledge gained in specific areas ....... 

Relating to people from the State Depat'tnent 

and the county offices 

Problem solving (the final session) 

The Hunan Relations Program 

Interaction of RST and MAR Teams 

•Well organized Inservice 

Sur;^cstion.q : 

Pre-MAR visit - team building simulation .... 

- iu a district 

More inservice on providing solutions to proDiens 
in the field. Vhat was given was excellent . * . 



. • • • • 



Er|c v. . , \ 5236 



9 

10 
2 

4 
4 
3 
2 
3 



2 
1 

4 
4 



4 



Additicnal inservice after several field visitations . . 
Jlore discussion with specialists in the field 

Additional acquaiucance vith rules and regulations - 
■Title I, II, etc 

None or no suGKCstl ons - it vas veil orr.onl'/.cd '2 

Continue present inservice ^ 

Additional team bul Iding ♦ • 

More do's and dou'ts sessions 



1 
1 



Cor r ants 



*'Ti::*; ; , ol i:.. jv. . tlu: State should conduct 

should havr rcc ^iwrd/' * 4 

(State) 

*'lhc <:o;\nt:v if. r»precint i v;» of an cpnor luuitv 

to worl: \:iu. ll.c. GLCto; thir, iielps us both.*' 12 

I (County) 

'*The co-jnty vn-tr. to '.^orK ?n coopcrnticn v;ilh 
th-:^. Gtnro r.^, liiin is plnrt>*ii. va do not: vent to 

do it ail.'* (Q.'.^'ce er/photic) • 9 

(County) 

"The firrjll r:ro-;-<> hjlp us krop on the bnll." 
'*Sr:cll rroups rrr- cho only vny to go," 
"Sr.n 11 r.roup? aro very si'ncrior to Inrre 

groups £or pcttinr; c.cross i.nf orr.ation, etc." 11 

(Stntc, & County) 

**Tiu: iuLcraccion is cqrriiic.'' \ 5 

(Stote & County) 

**Could ve hr.vc m-jrc te.ir: building?" , . . .\ 2 

'Vc v;nr.t norc r.p.rvrrs to prohlcv.s, but I f;uess 
it*s v\y job to r^ral ii\c r\'i 1 1? r 1 1 in the 

reference book/* 3 

"This is \;o.ll orr:tnir.(id , The neetinf, keeps riovinf,." . . 6 
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MAR n:s::Mvict: 
STAii: of £DUCation 

CALIFOiCtU COUNTY SCilOOLS 
>L\KC!i 12-15, 1974 



K\RCU 12 

State Personnel Board Root, iclb? 
801 Capitol Mall, Sacranento 



10:00 - 10:30 Joint County and State Cooperation ... Dr. Rex Fortune 

10:30 • 11:00 Mx\R as an Integral Fart of the 

Delivery System Dr. UiUicm Webster 

,11:00 - 11:30 The RST and CAP Process Dr. William l\ay 

11:30 - 12:00 The M\R Team Concept • Manuel Ceja 

12:C0 - 12:30 The >L\R Tean Process . . . / Edward Bispo 

12:A5 Luncheon - Mansion Inn Hotel 

700 16th Street 
Sacramento 

After Lunch Trip to Modesto (Mop Attached) 

7:00 Small Group Dinner - Holiday Inn 

1612 Dale Road 
Modesto 
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I MiHlosto County Cffici: 
801 County Center, III Court, Modesto 



« ,c „ 1 , ...... Mrs. Margery Ruby 

9:30 - 9:.'.5 '.relccne Coordinator, Mathenntics 

Stanislaus County Schools 

9:45 - 10:15 The >y.R Mission ' Edward Bispo 

10:15 - 10:30 Coffee Break 

^ ^ -r^;^ . RST and MAR Team, ECE 
10:30 - 3:45 The In:onr,.txoa tair San.gcnent lean. Co. 

Office Personnel 

Process: Continuum of 45 mnutes spent in each group 
by color-cliiod tcjr.;s: 

10:30 - 11:15 
11:15 - 12:C0 
. 12:C0 - 1:30 Lunch 
1:30 - 2:15 
2:15 - 3:00 
3:00 - 3:45 

Content: 

1. Dr. Jnr. as Kelson 

Fiscal and Administration 

Ha .aren-ont (6.0 - 7.0-8) 

Kcinteaoncc of Effort (2.0 - 2.0-3) 

Hlnir^utn and Maxin-.un Levels of Service (1.11) 

2. Dr. Vernon i-rovissaro 

Selection of Sc'-jooI i;itos (1.0 - 1.1-6) 
Selection of i'upils (1.2 - 1.2-4) 

3. Mr. Hal AtvJro-.'s 

Pro-ram Goal StatcTT.ts (l.A - l.A-3) 

Px-o-raia Corrponents atui Objectives (1.6 - 1.6-3) 

4. h!s. Barbara Sandran 

Needs Assessment (i.3-(t)) 

5. Mr. Frank Dvlcvan and 2 KDT Te.-'n Mcnbcrs 

Restructure o£ Co.v.prehcnsive Program 

3-45 - A:30 Question Session Team Leaders 
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MARCH 14 
Modesto County Office 



9:00 - 9:30 
9:30 - 12:00 



Coffee and Doughnuts 
The Information Fair 



RST and M;\R Team, ECE 
Management Team, Inter- 
group Relations, County 
Office Personnel 



Process: Continuitm of 30 ninutes spent in ' 
each group by color-clued tcanis: 

9:30 - 10:00 

10:00 - 10:30 

10:30 • 11:00 

/ 11:00 - 11:30 

/ 11:30 - 12:00 

Content: / 

1. Mr. Robert McCarthy 

Individualized Instruction (1.9 - 1.9-6) 

* 2. Mr. Larry Luna, Coordinator, Title I 
Fresno Unified School District 

Parent and Coirjnunity Involvement (3.0 - 3.0-11) 

3. Dr. Malcolm Richland 

Dissemination of Information (4.0 - 4.0-3) 
Evaluation ( 0 - 5.08e) 

4. Mr. Alex Gunn 

Isolation and Segregation (1,12 - 1.12-1) 
5* Mr. Morr.an Grccn-v^ood 

Non-Public School Participation (1.13 - 1.13-14) 



12:00 - 1:30 
1:30 - 4:00 



Lunch 

Are You Con^n^uni cat i ng? . . . 
A Dircussion of Group Effec- 
tiveness 



Dr. Haryjo Woodf in, 
Consultant 

Professor, Ca. Stale 
Univ. , Long Beach 



*Mrs. Lillian Barna stsbstituted 
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\ FARCH 15 
Modesto County Office 



9:00 • 9:30 
9:30 - 11:30 



11:30 - 11:50 

11:50 - 12:30 
12:30 



Coffee and Doughnuts 

In'plenentation of the A-127 MAR 
Instru;ucnt in Situations Found 
in the Field 



List of Assignnents and 
Counties to Undergo i^AR 
Process 



Evaluation of Inservice 
Lunch 



Group Discussion 
Dr. Marion Faustman, 
Leader; ECE Management, 
RST & MAR Team; 
Dr. Mary jo VJoodfin, 
Interactor 



Mr. John Apple 
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bU\R INScIRVICS 



PilOCSSS; 




in tho .'.-.•nda. Those 



-.bars viU lend color-clued groups ,thronf;h the variou^ groups naned 



iiLtending will receive colored badges: 



Erven 3rundage (Green) 
Martin Baur-'cn (Orange) 
Jack Djc'r.ott (Ked) 
John Apple (Yt^llcv) 
Art Jensen (Black) 



Start with Group 1 
Start vith Group 2 
Start with Group 3 
Start with Group 4 
Start with Group 5 



It is the duty of the N'AR Team Leader to see that groups do »ot continue be- 
yond the three-quarters of an hour (March 13X -Snd one-half of an hour. (March 14) 
time allotted; to r.ove sr.oothly from one group to the other; and to record 
then-selves or choose a recorder to write the infortr-ation in each group. Each 
group goes in numerical seq-oence: 



Green Team 

1 
2 
3 

4 



Orange Team 

2 
3 
4 
5 
1 



0 



Red Tean 

*> 

■J 

4 

5 • 

1 

2 



Yellov Team 

4 
5 
1 
2 
3 



Black Team 

5 
1 
2 
3 

r 4 



TEAMS: 



Green Team 

Erven Brundage 
RayiTiond Nelson 
Charles Dleything 
Ruth Sriith 
Alvin Reetz 



Orant;e Team 

Martin Bauman 
William Zachrreier 
Oliver ''Bud" Neely 
John Koore 
Wayne \\» Jorddn 
Frank Pipernto 
June V, de von Moltke 



Red Team 

Jack Beckett 
Kent Holtzclaw 
Edwin Liimcreau 
Willian Baker 
Bobbie Batchelder 
Sam Clorr.ens 
Marilyn Burtt 



Yellow Tonm 

John Apple 
Margery Ruby 
Cliff Rodrirues 
Daniel Foster 
Robert Morrill 
Rose Tolleyllollo 
Karen 01<;on 



:ciy 



Biack Team 

Art Jcns'^.n 
David Har;mond 
Ronald ilnckvalt 
Earl C\.?ens 
Dorothy Kraiis 
Harvey Wilson 
Tom Bauer 



Marion Faustman - 
Floating Team 
Member 

Bill Doyle, Reactor 
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APPENDIX E 



Consolidated Monitor and Review Services: 
Executive Summary of Revised 
Monitor and Review Plan 



t 



Consolidated Monitor and Review Services 



Exectitive Suimafy of Revised MAR Plan 



1»0 Phllosonhv-Pur poge (See Sections I dnd II) 

The goal of Monitor and Review services, as part of the Department's 
delivery system for adninistering categorical funds, is to assist districts 
to implement comprehensive instructional programs which meet mandated legal 



requirements and, i?ost importantly, which promote maximum educational 
achievement by each student. (Section I) 



lo accomplish this, MAR is committed to the following philosophy of 
operation: 

A, MAR procedures will emphasize the reinforcersent of promising 

programs and practices, checking for program and fiscal compli- 
ance only as precisely required in the law and regulations, 
while encouraging continuing self -assessment by LEAs. 

B« HAR activity will constantly stress ob jectiveness and openness* 



since all participants will be kept fully informed of all majoir 
program activity and procedures. 

C. MAR will respond to complaints quickly and effectively so that 



who generates a complaint. 
1«1 Cabinet Decision ; Are these principles appropriate as general guidelines 
for operation of the MAR program? 



We don't expect to have any "surprises" as the program develops 



the total program maintains an image of access 
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2.0 Specific MAR Obipcrives and Worknlcn (Sec Sections 3, A and 5 ,ilus 
Appendices 3 and 5) 

■2.1 1973-74 - Pilot VAR rsections 3_and_4) 

Cabinet has given approval (December 10 meeting) to initiating a pilot >!AR 
program during this December-June Period. Twenty districts will partici-' 
pate in piloting the YAK instrument providing a cocprehensive testing of 
the M-127 instrument and all MAR procedures. Two teaos, conposed of 
State Department and county office staff, will be assembled for this 
purpose. A Planning Team, in operation since December, has already made 
substantial progress as we prepare for visits starting in early March. A 
complaint unit will be established to provide pron:pt response to any field 
initiated conplaint. / ' 

2 2 197Z»-7S - Full MAR (Sections 3 and 5, Appendix 3) 

■ It is proposed that approxin^ate ly 1>0 districts/cooperatives be .onitored 
each year. The remaining districts (about 350) will be given the M-127 
instruacnt and be encouraged to undertake a self -assessment effort- This 
schedule allows us to visit the largest program every two years, middle- 
sized' programs every three years, and the smallest programs every four 
years. While USDS auditors have reco=^^iend^ a more intensive level of- 
visits, the above schedule repirescnts a dracatic increase in our conaait- 

■ ment. to monitor and review and is realistic organisationally. 

To complete the ISO reviews, six MAR tcana will each conduct 30 visits 
during the October-June period. We realize this nine-month period includes 
an overlap with the Regional- Service leans. However^ it is essential fcr 
MAR teans to operate throughout the school year in order to conduct 
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- comprehensive reviews in one-third of the districts « 

The MAR tr.ams will have the same regional Assignments as the RSTs 
vlll interact frequently (See Section 6) to provide oaximum continuity 
betveen LEA program icpleroentation and coaprchenaive planning for the 
next year. The complaint unit will continue to service any complaints 
received from the field. 

\ 

Ca1:^inet Decisions : 

2.2.1 Are the basic assumptions in Appendix 3 appropriate, i.e., should MAR 
have a goal of conducting comprehensive monitor and reviews in 180 LEA 
consolidates^ programs? 

2.2.2 Should all other LEAs be encouraged to complete a self-assessment each 
year? 



3.0 • Staff ins^ (See Appendix 3) 

All MAR assignments proposed would be accpmplished by redirection; thus 
no new staffing is requested and a BCP will not be required. 

3.1 FY.1973-7A - Pilot MAR (As ^|>resented and approved 12/10/73) 
3. 1.1 Planning Tran (December • ^jrHiary) ^ 

State staff: , 

Secondary' /Adult Program 2 
Compensatory Education 3 
Office of Evaluation 1 



County Office staff: 

^ Representatives of County _ 

Superintendents A (p art ^^^^^^^/^(^ 



I.l»2 rilot Te?.^s (February - June) 
State staff: 



; 



Cotcpensatory Education 7 ' 

Office of Evaluation 1 

GEm\ , 2 

\ Child Development 2 
(Availabte 3/15 
following ECE-M^ 

•ssignzsent) 



12 



County Office staff: (Agreed to in principle by County Superintendents 

1/25/7A) 

I 

March 4 
April • A 

May ' 4 

1 ' 

Each teata vill be composed of seven consultants (Sjstate, 2 county office) 
The ccxnplaint ^nit will consist of 2 consultants (both state). 
3.2 FY 197^-75 - Corolete !!AR Prorran 

A detailed analysis of vorkload and related staffing needs fir FY 1974-75 
Is presented in Appendix 3. In brief, ve propose to establish six tearas, 
each consisting of six members - 3 consultants from the Department of 
Education and 3 froa County Superintendents' Offices (on a rotating basis). 
In addition, a Coniplaint Response Unit would be staffed with 2 SDE 

r 

consultants* 

State Department staff (full time) 

6 teams x 3 consultants « 18 
1 complaint un^ ^''] » 2 
— 20 



County Office staff (full time equivalents) 
6 teams x 3 consultants 18 

(The nuurber of individuals to be involved'inay total 
as inany as 100. The assignaients will be developed 
in cooperation' with the County Superintendents' six 
area chaircen,) 

3.2\1 Cabir.gt Decision : Shall 20 SDE consultants be redirected for Monitor 
'land Review activity during 1974-75? . 



4*0 Orgaojtgational Relationships (See Section 6) 

It Is proposed that formal relationships be established with ten Regional 
Service Teams, with the ECE Management Teaa and with the Office of Evalu- 
ation* In each case, the proposed interaction is designed to facilitate 
coordination between elements of the delivery system so that ten different 
teams complement each other's activities and that the Department presents 
a'common approach when dealing with county offices and LEAs* 



To reinforce thiv cooperative focus, it is proposed that certain staff 
from each group be assigned either on a part-time or full-time basis 
vith the consolidated HAR prcgran. These are sunmiarized below: 
RSTs * 12 consultants 

ECE-Ii/kR (April-June) 6 consultants 

Office of Evaluation 1 consultant (full time) 



/ 

I 
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APPENDI5t F 



Consolidated Regulations 
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Doto : IJ<*ccini>cr 21, ill 73 
file No,: 



Edward L» Bispo 



C ON SO L I DA T ] : D i; L G 11 1 . \Tl ON S 

Ono oi" tilt, rt : ni.Mu-'jOi hi 3 of the TxiAT; efforl is to check nror.rnm roniph:uire 
v/ilh both ft-a:-:'.u ar.d -,t,^V" hL^^? ar:d r^j^MLViio:^..-,. ]]i j:* Uiori to nu'vt -riis 
rci^ponsib.:.*.- , ihc :.IA\[ i^h^irnir..^ t- .rn hps r.i'vivxncd i.; illu5arale conrrucncc 
bctv, ec*:* fecicx'ijl and m ;te law ivi our new cleiivery sysiorn. 

In ord:T lo Chech. conr^.-K n.c c*, ha\ t.-^ con^ir^icUd t:ioh^ cicf'j r:rv^d to srrve 
a3 cv cji:}ch hilt liiorou.h If/:.] rcfrrtii'.H- systf^:n v;h:ch sh;)v. ^ ;M']at.o;n-hi]\s 
hi tv, eon pro; tvun C'n»:'^';«is .iii.c Uv- ir.w,, I'lcadir.f-r op. Lr:." top oi iho cliurt 
rc py^'^en: r'l ::''\^rppi tu :i)iio\; n-^r.ior r,specis of t.^a- ^ic'V. ]\' c^'^.o^cct 
corj-0-.'.,v.v_a ,a\'>:'o\.j procc.-^.^ *h/i-' :n.\]ur^ iiL\'Ki]fa'o :.r t L oinni't^'iii iiSivo 
IMr.jii.iaj, hi-.cr% via .T.f *:i.M"!c:r oT l.ifort, S-Itu;:.. .n ot Schools and Pupih^ 

Di;^f r *un ,iiOa ol h a v*:r-::o::, :^ --ni; -aici ( cva:^iia :ly hivoivorpt. 
Part:ci::auo:i of Hulai-^n rai .-'jiivd :n N\;n- 1 'ahlic .^oiioo's, i \aiiiation. Reports 

C(jluniii refh cl5' ihc .ai\ora)prx:ao Koci.u^il i: a- IUjpiS, ih- i ird)i column 
vro\y:^^: .^rpaa,.a .a!- \* ivc ahita v aa aa- c.a\^/;-ren ixncod 
].,a'.iC.a:. \: ^..^aa .avcuo.i-. . 

Thif- iri?irarno\' -r:oi^]d hv C'Mi<^ i^loacci a^; a daail :a t!a^* :*t: :aa Wc <ire 
sh,ar:nr. ir \siti, you at. thas iiino to aoiaoi 3*our ccanniants pr:t>r to fin:il 
fjpprovcii. 

l^'if.'-S"-.' su:;::i;l .-ciir V. r:if"n rcaclituif, :iiid/oi- roco;r,:iUM!d,i,lio:is to jm': 
Attcnti'jn .MAj! I'lai;;-;:!-^ 'iCini. 
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APPENDIX G 



County Regional Representatives 
Six Area Chairmen 
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COUNTY liRJIONAL IffiFI^ENTATIVES 
SIX AREA CHAIRMEN 



Ref^lon I 

Louis G. Delsol 

Mendocino County Superintendent of Schools 

589 Low Gap Road 

Uklah, California 95482 

(707) 462-4731 

Region II 

Ray Darby 

Shasta County Superintendent of Schools 
Room 105, Courthouse 
Redding, California 96001 
(916) 246-5580 

Region III 

Milton K. Goodrldge 

Calaveras County Superintendent of Schools 

County Government Center 

San Andreas, California 93249 

(209) 754-3571 

Region IV 

Neal £. Wade 

Stanislaus County Superintendent of Schools 
801 County Center 
Modcoto, California 95355 
(209) 526-6575 

Region V . 

Gay lord A. Nelson 

San Joaquin County Superintendent of Schools 
Courthouse, Room 406-407 
222 E. Weber Avenue 
Stockton, California 95202 
(209) 944-2394 



Region VI 
James F. Cowan 

Ventura Count) Superintendent cf Schools 

Courthouse 

535, E. Main 

Ventura, California 93001 
(805) 648-6131 



«nd Olr9t(or ol Education 




STAT^; OF CALIFORNIA 

DEPARTMENT OF EDUCATION 

721 CAPITOL MALL, SACRAMLflTO 9S8M 

February 1, 1974 

Thio letter was sent to MAR Regional Representatives, Regions I through VI 



On January 25 at the County Superintendents and Assistant Superintendents 
Conference in SanDie^o, it was my pleasure to participate In the presenta- 
tion of an overview of the Monitor and Review Program.' A copy of the 
materials distributed at the conference is included with this letter for your 
reference . 

The cooperation we have had from the county offices in joint planning the 
Monitor and Review phase of the Consolidated Delivery System has been out- 
^ standing. The positive spirit manifested at the conference on the 25th was 
very encouraging. 

The main er.phasis of the MAR presentation at the conference was to assess the 
feasibility, of implementing the M\R program as a joint effort between the 
State Department of Education and the county offices. 

When the joint County-State Planning Team presented the proposal in San Diego 
for the i:npleraentation of h\AK on a cooperative basis, there was general 
concurrence with the plan. You will recall that the group requested me to 
pursue two Isr.ues throue.h the County Superintendents' Regional Chairmen. 
This letter constitutes a response to that request. 

Action Itrm i?l. (connty office representatives on MAR teams) 

It was agreed that each county office regional chnim^an would submit the names 
of two representatives frcm his rc-ion to serve as mcmScro ot the M.\R team 
for four visits, Ihe process- of selection was left up to the regional chairtp.in 
but the natres of the representatives should be subrattcd to Dr. Rex C. Fortune, 
Jr., Associate Super i ntondcnt , Secondary/Adult Education, 721 Capitol Mall, 
Sacramento, California 95814 by February 20th. 

Action Item (selection of districts to liAK) 

It was ar.reed that the county office regional chairrian would assist in the 
identification of districts to be visited during the spring of 1974. Each 
chairman is to submit the names of three dictricts: one large, one average 
and one, small. 
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February I, 1974 



The enclosed table showing the grant size of districts in your region has 
been included for your convenience. A map of the state displaying the 
areas of the six regions is included also. This information should be 
received in the office or Rex C. Fortune^^Jr. not later than February 15. 

The visitation schedule then would be prepared and the necessary contacts 
ttade to connaence the MAR process. 

It is understood that all MAR team participants will be provided adequate 
orientation and training before field involvement. 

Tour^ assistance in obtaining the necessary Information referred to above la 
greatly appreciated. Should you need assistance, please feel free to cfall me 
or Art Jensen at (916) 322-2553. 

Sincerely 9 



Rex C. Fortune, Jr. 
Associate Superintendent 
Secondary /Adult Education 

RCF:erb 

Enclosures 



# 
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APPENDIX II 
FIELD S?>;WICE REGIONS 



Regton T (71) 
(Northern) 
Del Norte 
Humboldt 
. Lake 
Mendocino 
Butte 
Glenn 
Lassen 
Modoc 
Plumas 
Shasta 
Siskiyou 
Tehama 
Trinity 
Marin 
Napa 
Sonoma • 



Region VT (87) Region IV (99) 
(Southern) (South-Central) 



Imperial 
Orange 
Riverside 
San Diego 



Inyo 
Kern 
Kings 

Sao Bernardino 



Region 111(103) 

(Bay Area) 
A laoeda 
dontra Costa 
Monterey 
San Benito 
San Francisco 
San Mateo 
Santa Clara 
Santa Cruz 

Region V (74 ) 
(LOS Angeies) 
Los Angeles 




San Luis Obispo 
Region II (99 ) Tulare 

(Central) Santa Barbara 
Alpine Ventura 
Amador 
Calaveras 
Colusa 
El Dorado 
Fresno 
Madera 
Mariposa 
Merced 
Sacramento 
San Joaquin 
Mono 
Nevada 
Placer 
Sierra 
Sutter 
Yolo 
Yuba 
Solano 
tanislaus 
lumne 
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APPENDIX H 



Consolidated Monitor and Review: 
Proposed State/County Joint Services, 
Emphasis on Monitor and Review ^ 
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MON l i ^'K WM \ 1 : ^: 
? r o p v» 0 k\ ' 

^, * h t ;i I r / ('. i) u n ' \ ' I u I \ r ; \ 1 1- 
i:;\:!^MASIS ON MAi( 



OhjcctivcxS: 



At the end of rhis presentation county supiTinlendcnls anci^sistant 
siipennlciidcnis will he able to: 

1. State that *'^'os", Virtiinia, there is?* delivery system" ar»d sequence 
llie four tunclious v;itiiin (lie delivery system. 

2. Describe t'ne^ county supei iutcn<ient "link-up" with Don McKinlcy on 
the delivery systcn}.^ --^^7^' 

3. Dc'finc and relate: 

, - delivery system 

- comprehensive pro;^ram plannin^^ 

- con^.olidnled application processing 

- coniprehensivc proi:i*am application 

- comprehensive program monitor and reviev/ (MAR) # 

what, hov; and when 

- promising proi^ram practices 

- A -127, 1M27, K-127, M-127 

4. Sequence the WAR pilot ^'Ctivities siis:g,ested for district/ 
cooperative, comUy onices, and State DcixirtnuMit for this spriiig,. 

5. Descni)c prop.)SLd rel:aionship of district/coopji'arivcs to 
county offiv-^c lo Ntaic^ Dcpariment m i\ MAR fun'cironal cooperative 
for 1974-7r>. 

6. l.ist t'ne ]^:'r5A)iir.vl .'ind 5.-. I'v'icc sijpp:)rt. . . requirt inejits fc>r cojuty 
offices and Si.ire OLpartint-nt XMlh.m the MAR pilot this spring 

and the MAR operation m 1^)74-75. 

7. Descnh.e M-\i\ tools bi) far c'vvelopcci, 

8. KehKe co'in/ v-oinee Il-vImp'S mui It ^iiii cU compli'.NnK i.is 
c xpei u u < .1 V. it^iin li:* M \ iv M.n't -ep ..etivil ic;.. 

9. Jtujrcl L'le i.'\p:'Cteci luir^' "p.ir-ofi" for ( oi:nl\ ofiices and 
Slate 1); pin;M.u* \Mlhin :i coopcratr-e M.\;l. 



(ieneral dlSCl)^^iv^»n 
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CONSOLIDATl-D MONUXM^v AND RKVIKW SF.RVICHS 



Goal Statement 

The Department of. Education believes that local education agencies must design and 
implement instructional programs which accommodate the highly individualized needs 
of every student, whether the student is just entering school or is participating in a 
specialized pi^gram as a mature adult. Vv iuiiii California's pluralistic society, 
these needs are often very diverse, including such areas as bilingual education, 
intergroup relations, e-iu cation for the disadvantaged, the handicapped and the 
gifted learjier. No longer should all students be required to conform to a generalized 
program of instrjction; rather, schools should develop instructional programs that 
truly adapt on a continuing basis to individual student needs. 

The goal of Consolidated Mointor and Review (MAR) Services, in- conjunction with 
the other phases of the Department's delivery system- -local comprehensive program 
plamung assistance and consolidated application processing--is to assist districts 
to implement comprehensive instructional programs wiiich meet mandated legal 
requiri-ments and, most importantly, which promote maximum educational achieve- 
ment by each student. 
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KAR ?ROCi:in'?E PUN 



Prc-Plannm;^ ' ^ 

!•! Letter is sent to the district to be visited indicating dfltes for 
po88lble MAR visitation and asking district to approve dates. 

1.2 Ttie MAR Coordinator working \fVt{^ Program Director «chedulc8 interviews 
for individual M\R tcaa roerabers with prpgram personnel within the 
dlstript to be visited. 

1.3 Materials are prepared for consultants 

- Material check list (Fonn H-3) * . ^ * 

- Assigr^cat sheet (Fom M-4) 

- H-127 

- Report form and instruction sheet (Forro M-2) 

- On-vsite guide reference (MAR Ref . #4) 
• District sutnmary sheet (Form M-I) 

- Other 

l.A. MAR Regional Coordinator reviews the purpose of MAR visit with the 
entire rIAR tean and appoints team captain for the visit and distri- 
butes materials 

On-Sile Visit 

> 

2.1 MAR team reels as a j2;roup with the district staff to become oriented 
to the consolicirited pro.'^ranj offered in tho district. 

2.2 Individual M»AR team r.embers conduct scheduled interviews. 

2.3 K/iR ceatB meets as a groups at the end of each day. to sumoaarize findings 

2.4 The cvenin;; before the exit presentation, ' the team drafts a report 
babcd on the iindi.ngs» 

Pre^>ent:Ati on 

3.1 The report it; read to ^he distriot staff as an exit presentation on 
tlie last day of the visit. 

3.2 District perscjnnelr viny subir^it coinmcnts for consideration in the report 

4.1 The report is edited after KAR team returns to State Department of 
Kciucation' Office. 

4 

4.2 Tho report 'is read and approved by the MAR Program Manager. 

4.'3 After npproxiir^tcly one month frorj the date of the MAR visitation, the 
district receives the report. 



f 

K\R PROCroURE PUN 

4.4 Dis'rrict tnay subrait a response to the K\R report, indicating con- 
currence or lock of^concurrcnce with the various concern? identi* 

y fled by the vlsitinf>\y*AR team. In the event that points of non- 

concurrence are citcd^ a review will be C3de and the issues discussed 
vith the district. 

4.5 The final report is sent to the district for tlieir use and to the 
E«S.T. and other agencies as required.- 
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State rersop-cl licard :-:':r- -1^0 



10:00 



10:20 Joint Counly anJ Stntci Cooper^t'cn ... Dr. Re?: Fortune 



10:30 - 11:00 cs rn lrtec;ral Fr. rt cf tivj 

CvQ-. ri ! 



ir.CO - 11:3? 'li.e rST r.r.ci C;.r ?iO':..!5s 
11:30 - 12:C: Z 



, . Dr. l.'illiarr. V.'ebste 
, . Dr. VJilliam r.r.y 



Terr. Co:;copt • M-nuel C-ja 

T- r-". rroccss . . , >ir . Edvard 2i5?C 



7uO 16th St.'cot 
Sacrrrer.ic 

After L^i:.ch Tri;^ t l-^rtc .MLrcnec) 

Srall Grj.ip Dmn-r 



1C12 Iialo i.orc 
M-^des t o 



ERiC 



Modesto County Office 
801 County Center, III Court, Modesto 



9-30 • 9:45 ^.lelcore • ^^^^">' ^^^^ 

^ Coordinator, Mathematics 

Stanislaus County Schools 

,9:4^ - 10:15 The ^AK Mission ' "^^^^ ^^,^P^ 

10:15 - 10:30 Coffee Break 

10:30 - T:-45 The Information Fair • • • RST and ^'f ^ean, ECE 

" Managenent Tean, Co. 

Office Personnel 

Process: Continuum of 4J minutes spent in each group 
by color-cluad te.itr.s: 

10:30 - 11:15 
11:15 - 12:00 
12:00 - 1:30 Lunch 

1:30 - 2:15 

2:15 - 3:00 

3:00 - 3:45 

# 

Content: 

1. Dr. JaiTies Kelson 

Fiscal and Administration 

Kanar.C:r?ent (6.0 - 7.0-8) 

Maintenance of Effort (2>0 - 2.0-3) 

Minipum and ria'.'.in.un Levels of Service (1.11) 

2. Dr. Vernon Broussarc^ 

Selection of School Sites (1.0 - 1.1-6) 
Selection ol Pupils (1.2 - 1.2-4) 

3^ Mr. rial Andres 

Pro':;ran Goal Sta tcr^ciacs (1.4 - 1.4-3) 

Program Corr.poncnt: s and Objectives (1.6 - 1*6-3) 

4. Ms. Barbara Sandnvm 

Needs Assessment (1.3-(t)) 

5. Mr. Frapk Dolcvan nnd 2 R2T Te?n Monbers 

Restructure of Co- pr ehenstvc Procram 

3:45- 4:30 Question Session Team Leaders 
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MARCH 14 








Modesto County Office 




9:00 - 


9:30 


Coffee and Doughnuts 




9i30 - 


12:00 










Manager.ent Team, Inter- 








group Relations^ County 








Office Personnel 


• 




Process 


: Continuum of 30 irinutes spent in 








each group by color-clued teams: 








9:30 - 10:00 








10:00 - 10:30 








10:30 - 11:00 








11:00 - 11:30 








11:30 - 12:00 


- 




Content 


: 






1. Mr. 


Robert McCarthy 








Individualized Instruction (1.9 - 1.9-6) 




* 


2. Mr. 


Larry Luna, Coordinator, Title I ' ( 






Fyesno Unified School District 






s 


Parent and CorriT-.unity InvolvemenJ^ (3.0 - 3.0-11) 






3. Dr. 


Malcoln Richland 








Dissemination of Infornat Ion (A.O - 4.0-3) 








Evaluation (3.0 - 5.08e) 






4. Mr. 


Alex C'jnn 








Isolation and Se£;reg^tion (1-12 - 1.12-1) 






5 , Mr . 


Morc;3n Greenwood 








Non-Public School Participation (1.13 - I.l3-j4) * ^ 




12:00 - 


1:30 


Lu nch 




1:30 - 


4:00 


Are You Corr^mun icat in>>,? ' Dr. Maryio Woodfln, 








A Discussion of Group r!ffcc- Consultant 








tivencss Professor, Ca . State 








Univ, , l.ong Beach 




♦Mrs. 


Lillian 


Barna substituted 
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KARCH 15 
Modesto County Office 



J'- 



9:00 - 9:30 
9:30 - 11:30 



11:30 - 11:50 

11:50 - 12:30 
12:30 



Coffee and Doughnuts 

Iirplementation of the A-127 
Instrument in Situations Foirnu 
in the Field - 



List of Assignncnts and 
Counties to Undergo MAR 
Process • 



Evaluation of Inservice 
Lunch 



Group Discussion" 
Dr. Marion Faustman, 
Leader; ECE Management, 
RST & MAR Team; 
Dr. Maryjo Woodfin, 
Interactor 



Mr.' John Apple 
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M/\R INSi-RVICE 



PROCESS: ' ^ 

■inV!''-' ^-tT'^'r^^ ^""""^ color-clued groups through ^he various groups na=u.d 
xn t..e ..^v;nda. Those attending will receive colored badges: 



\ 



Erven Brundage (Green) 
Martin Baur:on (Orange) 
Jack Bjckect (i(ed> 
John Apple (Ycllcv) 
Art Jensen (Black) 



Start with Group 1 
Start vith Group 2 
Start with Group 3 
Start with Group 4 
Start with Group 5 



iond%f/^^ " MAR Tean, Leader to see that groups do not continue be- 

tZt ann^^^rT"''" °^ ^'-""^ °f hour (March 14) 

tine allotted; to r.ove sn^oothly from one group to the other; and to record 

IrZTllT °" " ^° ^^^^^ the infonnation in each group. Sach 

group goes in numerical sequence: 



\ 



Green Team 

1 
2 
3 

4 

' 5 



Orange Team 



Red Team 

3 

4 
5 
1 
2 



Yellow Team 

4 
5 
1 
2 
3 



Black Team 

5 
1 
2 
3 
4 



Grecp Te^ 



Erven Brundage 
Ra>Trond Nelson 
Charles Bleything 
Ruth Snith 
Alvin Reotz 



Orange Team 

Martin Bauman 
Williani Zach.T^eier 
Oliver "Bud'* Neely 
John Moore 
Wayne Jordan 
Frank Pipcraro 
June V, de von Moltke 



R ed Team 

Jack Beckett 
Kent Holtzclaw 
Edwin Lamorcau 
William Baker 
Bobbie Batchelder 
Sam Clen-.ens 
Marilyn Burtt 



Yellow Tonm 

John Applo 
M<irgery Riiby 
Cliff Pvodr i ;:ue s 
Donicl Fo5^t(!r 
Robert ^!orr^U 
Rose Ta 1 ley-liollr-vciy 
Karen Olsoa 



Black Tea 



Art Jensen 
David Htin^mond 
Ronald Ilockx'alt 
Earl Ovens 
Dorocby Kraus 
Harvey M i 1 son 
Ton Bauer 



Marion Fajstman - 
Floating Team 
Member 

Bill Doyle, Reactoj 
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1 



APPENDIX N 



On-Site Data Sheet for MAR Consultant 
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Monitor, and Review Report 
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V/IISON WMZS 
kr:ndi;it ol PiM;- In-tri-t.c.i 
rf Uif rtct ot I Ju-Tion 




STATir or c.'Ai.iroRrs'iA 
DEPARTK1E^]T OF, EDUCATION 

ST^ir. luJC/.Tic; ru:i.r:;;:;, v\ capstol mau SACRAMLrno c'.bm 
Apri.1 197'i 



Ir. Qucntin R, "aylor, I'upcrintcndcnt 



iccr I'x, Taylor t ' ^, ^ 

Monitor ar.d P.evie*.:: ^ 

hank you .and your staff for tlie r^,uy court^nies 'vcccrdcl the J'onitor end Ilcv?cv 
ea^, J.'ecaufG of tho f ine - cocperaticn the loan received, ve b 'vo r nuch letter 
nderstanuinr of your district effort to develop exor njary cdwcat lorr-J I'Md 
ana(:c^ont procticvr;, 

Lnco the tern^j* vir.it to yov<r school dirtriet vr'\i\' r-a't C)f^ pilcu projev'^L, v/c 
re r.ost i^iteres^ed in roreivmr your cc: -^eiit^ on tho cf rectivene:.? of t^'O 'TkR 
ocesn aL ^'c.ll a^ t::e vri^^uo' of tho infv-* .atior con .'^jne'a mi tro r«_rort lici'eir: 
ncloncu, Tn-ent ] ally . ^}.ir. rcT'ort provide"; you v'lth a reco-"^^ of tho concernc 
nd is.sucs cov^ rov in the c;;it ccrfcrmce i*':Volvi::/ l]? ^ 'onitoi' and T'evicv te'i^n 
nd Pcnbers of >c*ur cLaff, It iz jnteiiced that t h^r infornatioi^ included in ^hi s 
epor^ vill be used to cnhoncc j;roc;ra'^ curLlity and off ectivenc^s • 

>piec of tbif. 1 c^o^*t ''..•i.ll he sent to tr.e^ cc*-iray ci;; erint er':^ : I , yoi^r rro.'ect 
rcclcr. ai.d r> r.air/'Tr of tho Ctv*^^ ^ n^v'^r.onl c<: hducrticn'r. Icci^i-'i- C'crvices 

(rfj'l')* Jn order \c fa^iliLaoO the' i' eler^cnt''^ ■ on o^ the I'cccrjr.enaatiOLf, 
:>nLD5iird in thi: report, tie ^.ar.a'ter of^ire Ivr^i "^'.11 •or.'fact yc\ir rroject '>.rector 
I thr> very mar fi:uure to c-velc^) a :.tri^L'ry of ir^i^i '^.'irnl atiri!i, 'ihe nana^;er of 
le liSI acGirncd lo your dl'Ltrict ir> 

Mr, /J.Ien Coltharr. - Tele; heric 3^cl?.-3''*['^:. - /a^ea 9l6. 

Mir cooper^ lien :r av-^r^ • * o ; , ar ; f.'r:.'"yd a ^^oritinuin^;: vorl:ir.f 

?lat?cnr:.in ih>'r.^-h ir? ; :'r.»*s to cc'\:. 

ncerol y, 

(■ -i..b„..w 

:x c. FOrrihri:...!*:, 

;f.oc:ate ru^:**: ir.c r/^' -^Z 
Secondary/.'v^u] t : du!'•at.ic^ 



iclof;rro' 
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CALT.von.JiA rvfATi: i)i:r/n'irn::;v ok jioucation ^ 

Monitor and Hcv;cw Report 



)i strict 



Comity gY.ir/' r^* 



JurcrintcnJont 



Project Director 
Project ?;UiT.bcr 



)atcs of Visit A^rij^ :.oih 

C7A mmU'J CTAFF 
County Schools Office - TEA Etaff 




:> 



^no Jordan, .i'rcr.no County Office 
'f,cry Puby/ CtaninlauG County Office 

e/({Gjrrond, Ct:tto l^onartricnt of I^duc^'.tion Frank }'ircr;ito, Ttato Dcp::^'t:7ent of I. ducat ion 



Bain Clcr.cns, Ptnte Pepartncnt of f-ducation 
Merilyn Burtt, Btatc D(*partnent of Education 



lEA Perro-r^ol Ir t^^rvi ovci : 



/T7 Princir-alr. 
/TJ Parent:'. 



/y7 ^uperintr:::c!ent ' 
7x7 Aic!er./;'aranrof or.ricn'J n 
ZZ7 Advj:;rr:" Co-vittcc !!c;nbern CJ Btudontr. 
CJ SuT^ervifcro ZZ7 Hcnource I'crr.on 

Tarrct School r Vir^ii';-'^: 



Z27 Tcac}u:rs 
/Z7 Volunteers 
/27 Project Director 
Z27 Other 

(Bunineos ?'.anaf,cr) 



IliTHOD'JCTlOr; 



\ 



California Ttate ''cT^arlMcnt of Kdo'-'^.t ic-n has l>:e rer.vonr i ^-i 1 ity of conVluctd n,':, a 
itor rr.:\ rcvi^-v {'%\':<] of all vrorr.r: vith:n Vr:- cm: i t^'l L.yrlicvliov. . T};o I'-S 
m nonitorr. r.nJ ^-ovi' dirtrDcts iKud i.cpoolr> rc]alivc' lo cc.-^r lir.nce vit.h reouireo rro-- 
c3c:cr.V:.. Tr.in involv-, cxt^^r r.iv*-^ er-r Inalic-i of rll cf ll.c varioiir I'couireci ':r:cc:tr 
the- r.:>cci:'12y :\::.icd rro.-rrjj.. Vo acccri'^^rh thii. ]ycvt(\\rc , tho ec':::)oitc r.on^'.c r^:.3 
tru'^cnt (!'~ir7) i.'i';. be^*r: ocvejopcd rervo r:r>, a f.uidc for 'che consul car.jL . An cutlir.e 
•tlic co^.roni'Le ^'-IP? ic incl'.:a'''d in ^:.ir re: r^rt f ^ r t*.o ccnvenicrico of' the reader in\ 
niiir :«jvr,: : cf V*." rr.tur^' of ; ^.^ ccnnr l :\' : ve ^ro-r/r: rcvic'*:. lii iiddi^ticri, a 

y of the c:'\-c:,'tc ar-i revif.; VrrJrr.r oi" Irir\::ry (:'-ir'V) in left '^'ith the dir.- 

ct du^J'r : i; rrcl:*-.::-.-.: y riaimai.c; for tiie vir.:t and it ec'-lainr. L'ho bar.ic critcrra on 



nn:] cMivtv cff: 



c»-' 



te/: '.h 



" I \^t;i th-r coc v-'i'-'.l Ic li ard : r ) M:*::''* ■ o:' yp\:- ri-Tf. 



•j'i'.ed yo-.n* district v.\i^', col- 
, >' ^ 



c V tl c di::;>r: 



r rc n ro ' rrr' : ?r; • r hey:- royi d 
:'. d : r : ( * r r c v r ? • p ' < v 1 in v h : r v :* f !' (' "it V r i c t 
, It ^hculd ti- :("--tcT» ! t)r.t f c r 1 !i" :,:.he o/ and dir(--ct ci v^nni catic n , .air: 

orl in n''.t/-''" cC > r\r*-!'t:ri; r'-^'^^rt. :,\c'c*'t ^d.-rc r.ot-d, t: c crntolidat' ' 

rr:*:" v\.-., fo'-:.1 in cc ^1 : vitli i-f 'u Lai : c^n^; . fnecifac cn: r^-n^niticnr. arc t'tatea 

P. Jlc ' r'^c'vir:r-; rr ''inalion are idfnliric.i en ]\\rc ar.di are dincur-r cd on 
ccqucM i-:--.-L>. A' 

'ERJC'— iKtV -'Av,;,.-vh-:;\-:,-y--: 

Asr.oC'jale^ T'lr- nl »■! (T !vbl:c Tn'^t nuc I : m 



Apri] P-Ji, 3 971; ' . 




^ l)ir,trict - staff nrQ ccrncndod for the roccplicn accorded Vac team 
onsultar^ts at a (liffic\ilt tine viicn zc r.any other activitic:*. vcro bcinf, conducted 
iinultai^counly , i*c-, parc;:t conft^rencen , the tertin,-: procrcj^, etc. 

Vlie orr,ani;:ctio:^. of inforration relative to tli<^ lir.t of prorrrn piKrlici- 
'antr., th.e^r ciiniLility and L»tatur., vac very veil done* The orifanal cliarts and 
brms developed by staff ciioultl facilitate rood r.anafxriCJit practices as veil as 
-ccountabi] ity , 

The project staff are ccr.r.endeu for nn.kinf3 sat i of ac, Lory profrers toward 

rie iridivi'iuali::aticp. of in: truction in ];indi^rc'*r t^^n ( prij^-^ry f;ra':c cIa3sroo:r.3, 

Parent cJucaticn activities s'jch as t^ie current <^o\;rre in nutrition, 

> 

orhshop cii ''}iov; to Cor;.:uct J'.eetin-';" , and i-articipation in rel''va;it conferences 
re co.Tjncnd/A'Ie achicvc-.'^r.^s. 

rroject staff are cor:'iC:,ded "^or the ::anncr they \-cre rAuc to r.ininir.e 
he adverse effects of a tnrrover of ac-ur.: stral i vc j^rc^:.:.vl rv.r r ir.ultaneously 
ffcttuate desire.: crVjrc and prrrresr. 



f! ff f; 

y 
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CONSOLIDATED PROCIUM ^ 
« 

COtPOSITE H-127 CONTFJfr OUXLUiE 
A&EAS AND TOPICS UIXHIN A££AS 



Area 



Compl* 



iXCM 

Are* 



C 0 N T E H T 



1,0 COHPREIIHNSIVE INSTRUCTIONAL TX^^S 

\Ul Selection of School Sltc(«> 

1.2 Selection of program Participants 

1*3 Kecd^Aaaetmukta 

U4 Co«l« 

]^ Restructure K*3 



X 
X 



1*6 Prograa Coiponentt and CbjecUvea ^« 

1.6.1 Multlcultur«V^catioii 

1.6.2 • Staff .Deyelopaent 
, 1,6.3 V Language DevcJnpceat 

1«6.4 Reading 

K6.S Hatheaatlct 

1.6.6 Parent Education 

1.6.7 Parent Jnvolveaent 




1»7 (Co&blned with 1.6) 

Xdcti^flcatlon of Resources 

1.9 Ir.dlviduclitatlon of Instruction * 

1.10 (See 7.0) 

l.Xl MlnlDuo *nd Maclooc Levela of Service ^, 
I.lUl CoBxentx*tlon of Service* 



1.12 laolallon and Se^regetton *• 

1.13 rar^ldpatioA of Pupila from iJon-Pobltc Schools 



2*0 KAlNTrSAKCE OF trFOR/ 



-yZO PARENT AN.^ CCy>:"JNiry INT&I-V-y.ENT 

(District -enr* Scnooi Ai:visory t^=ailt.tcc&) 



X 



Ares 



ERIC 



4.0 DISSyT'^ATIGN OF IfiFOKM.*. 

5.0 ALU ATI ON 

6.0 FISCAL AI^O ADMINIST^^TIV 





6.1 




6.2 




6.3 


X 


6.4 


X 


6.5 


X 


6.6 




6.7 




6.8 




6.9 



7.0 PROCRA.M yj^t-Ar.:y.:-itT sr^j^ (AN A'-mcAL d: ykimw ) 



• Hot required until 7'»/75 
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Product 
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Monitor and Review Observation and 
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CONSOLIDATED PROGRAM 
PVi-1'27 DISTRICT LEVEL 



P«-1'27,DI^ICT LEVEL 
\ >/OCRAM ^E'VIEW - joints OF IN^QUIRY ^ 



INTRODUCTION 



r 



The combined coop.eratlon of County Suoe r Int end(. n t s bf E^ucaiion, local educational 
agencies, and the State Department of Education has produced these district level 
points of inquiry. The purpose of **his instrihnent ii to assist in the review and 
examination of consolidated pl'ograms at the district level for coapliance with ^/ 
Federal and State Regulations and Stat« Department of Education policy. 

EXPLANATION OF USE 

* 

1. This instrument is primarily designed to e used by a State Department of 

Education review team. It may be used by districts for sel f -ana ly s is , but the 
results are not to be reported to the State Department of Education. « 

l/ Those points of Inquiry which are negatively wooded are taken verba t im from 
regulations. The use of YES/NO answers require^ equating with TRUE/FaLSE 
i answers to reply logically to those points of lnq.jul ry ; I.e., if a s ta temen t 
is true, mark *'YES*', if the statement Is falseJmark "N0*\ 

3. * The roa]or levels of inquiry (i.e., 1.0, 2.0, etdi*) are to be answered by first 

answering the su^^level poi'nts of inquiry, which are specific questions. One 
or more "NO** answers in the sub-leve? point of inquiry warrants a *'H0*' answer 
in the major level point of inquiry. 

4. Use of the B 1 1 Ing^ual /Cros scul tura 1 section of this In'^arument in determining 
compliance with bilingual requirements iff determined by the following: 

a. A district with schools having one or more students whose 
primary language is not English, but which have fewer than 
13 parcent of such pupils, must have a locally approved 
plan for meeting that need. In Section 10.0, respond only 

• to 10.0-1. 

b. , ^A distr^ict with schools havlog 15 percent or more children 

whose primary language is not Engllsb^must have a Bilingual/ 
Cr osscu 1 t ural component. In Section lO.O, respond only to 
10.0-1.. 

c. * A district which receives Afi 2284 bilingual funds must complete 

Section 10.0. 

5. The 'Authority Key/Section" columir in the Points of Inquiry Yef.ers to a speci- 
fic regulation or policy found i\n the following official documents: 



Regulations for Consolidated Categorical Aid Programs (Title 5 and 
Federal)* 

2. Instructions for Compi'ting the Comprehensive School Program Plan 
(A-127S) 

3. ^nivt ructions for Comp rcnensive Program Planning 

4. Addendum to Instructions for Comprehensive Program Planning (NPS, N&O, 
Co-op) 

5. Mai:ageroent Information and Requirements for Programs Funded through 
A-127 

6.. Consolidated Application (A-127) 

7. Manual of Instructions for Completing Consolll^ted Eval^uatlon Report 

8. Title 11 State Plans 

9. Policies for Early Cnildhood Education 
10. AB 2284 



*1S a State Regulation 
IF « Federal Reg'ulatlon 



1.0 

l.l 

U2 
1.3 
1.4 
1.5 
1.6 
1.7 
1.8 

1.9 

2.0 

3.P 

♦ 

4.0 
5.0 
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7.0 
8.0 

9.0 
lO.O 
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pourrs or uwm 

TOPICS ' - PACl 

Go«N>«hmiv« fropem Plawunt . ^^l 

S«l«ctioii of SchM>l UtmU9(f 4rM« *«. ^ . 01 

Selection of ProsrtfK PortUlp«iito r...^..-***. ^ 

Moods AooooMMt .... ^ ^ • 05* 
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-POINTS OF INQUIRY 



DISTRICT LEVEL 



PU 127 (FY 1974- 
I^ev. 8/14/74 



'5) 



1 . 

0 . 



AREA 1>0 TOriL\ 
SOURCES OF INFORMATION 



Program DiVector 
Business Manager 
DAC 



4 , Appl ic a t ion 

5, Planning Products 

6, Evaluator 



AUTHORITY 
KEY/SECTION 



3:1.0 



,3:1.-5 



POINTS OF INQUIR' 
DISTRICT LEVEL 



CO 

u o 



CO 

Ul o 



>• 



SOURC 



I*': 1 1^17c,d 
IS: 3934d 

/ 
/ 

3:1.5.2 
1.5.8 

3:1.5.2 

IF: 116. 17c, 

d,f 
IS: 3934a, d 



3:1. S. 2 



3:1.5.3 
IF: 117. 3d 
IS: 3^34e 
8: 
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1.0 
1. 1 



COMPREHENSIVE ,PROGRAM PLANNING 

Compr eKensive program planning 
*was completed for the district. 

Selection of Scho/1 Attendance 
Areas 

School (Tt^enda/ce areas were 
selfcc te^^ccording to regula- 
tions for each of the programs 
i' . luded in the district con- 
solidated application as listed 
be^ow: v 



1.1-1 



Title I 



(a) Source data were col- 
lected about low-lnc>^me 
families which were 
identified by the use 
of 1970 census data, 
AFDC data, or secondary 
source data 



(b) 



Source data were used 
In ranking artd select* 
Ing school attendance 
areas using computed con- 
centrations based* upon a 
perc^ent, a number, or a 
comb i nation-* of both , of 
children froc low-income 
' families 



1. 1-2 



Title II, 



(a) There is evidence that 
^the selection .and dis- 
tribution of library re- 
source materials In- 
cluded the foil owing 
criteria:* . . . " . . 

(1) Quality of materials 
avail able. . . . 



(2) Quantity of materi- 
als available. . 

( 3 ) R e q u ix t*mc n t r> o f ^ 
chi Idren in special 
Ins t rue t i oiiu I pro- 
grams. « . * . . 
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.POINTS OF INQUIRY 



DISTRICT LEVEL 



PR 127 '(FY 1974-75) 



^^^A 1 . 0 TOPIC . C^^nvi^h^ngr.^, Pr^^^..n: 

SOURCiS OF INFORMATION 

1. Program Director'^ 4. Appllcatloft 

2. Business Manager • 5. Planning Product* 

3. DAC ^ 6. Evaluator 



EKLC 



AUTHORITY 
KEY/SECTION 



IS: 3934b 

3:1.5.1 
1. 5.6 



IS: 39l^b 



3:1.5.5 



POINrS OF INQUIRE 
* DISTRICT LEVEL 



— 1 



w o 



o 



1.1-2 (Cont.) 



(4) Requirements of 

teachers In spec la 1 
Instructional pro- 
grans 



(5) Requirements of 

children In exemplary 
school programs. . .. 



(6) Requirements of 

teachers In exemplary | 
scnool programs.^ . . [ 



(7/ Instructional irate- 
rlal for cultural and 
linguistic needs of 
children 

(8) Degree of economic 
n e e s . . . . . . 

(9X-The distribution of 
such resource mate- 
rials was not made 
solely on a per 
capita basis. . . . 

(h; Adoption of a material 
seAect Ion policy was 
.made by the district 
school board. . . . . 



,1. 1-3 



ECE 



(a) At least one-half of the 
ECE funds go to schoolf; 
with the greatest concen- 
tration of pupils with* 
educational needs in grades , 

-, . _i. 

(b) The district master plan 
for ECE Includes the se- 
quence ir which schools j 
\*ill eQter the program.. . [ 



Miller-Unruh 



(a) Schoo> si-te was chosen on. 
the is of the school 
with th»e largest nutnber of 
children achieving below 
Ql acco.rdlng to the first 
grade reading test. . . 
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POINTS 8F INQUIRY 



DISTUCT LEVEL 



PR 1?7 Cfy 1974-75) 



AREA 

SOURCE& OF INFORMATION 



TOMC 



1 . 

2 . 

3j 



Program Director 
3 u sines s Mnnager 
DAC 



I -dan i ng 



Application 

5. Planning Products 

6, Evaluator 



AfT«C?.I7Y 



IS: »9'»4f 



VCINTS Il'IQUIR" 
DISTRICT LEVEL 



u O 



SOURCE ; 



l.l- 



( COtl t . ) 

(b) 



153: or more of the K-3 
stuoents in the schools 
having Killcr*Unruh aides» 
11 ve in homes In '.which * 
other than English Is the 
primary language., acd not 
less^ Chan 30^^ of the stu- 
dents score in the lovest 
quartlle in tht: first 
^rade rcsoiug test. . . 



j lS:393Ac 
r 3:1.5.1 



lS:393Ac 



lS:393ArC 



i.1-5 



EDV (SB 90) 



(a) K-6 schools were ranked in 
descendi'r.g order and the 
school sites with thu largest 
percent or number of pupils 
scoring In the lowest quar- 
tlle lo a basic skills test . 
w .re selected ' 



I 



(b) 



(c) 



^election of secondary 
school sites was based on 
the participation of feeder 
schools in the EDY pro- j 
S^ani ^ 



Union High School Districts 
have a 1 located funds to 
schco^s o-f greatest need, 
wltn preference to sc'hools 
serving the youngest stu- 
dents 



ERIC 
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POINTS OF .INQUIRY 



DISTF.ICT LEVEL 



PR 127 (FY 1974-75) 



i. 
2. 
3. 



AREA 1.0 TOPIC 



SOURCES OF INFORMATION 
Program Director ^« 
Business Manager 5. 
DAC 



Comnr^liens 1 ve Progra m 
Planning 



Application 
Planning Products 
Evaluator 



AUTHORITY • 
K£V/SECT*ION 



IS: l<53Aa 
3:2.4 

e 

3 : 2 . <» . 3 



3:2.4.3'^ 
15: 3934d 



'3:^.4.3 



POINTS OF INQUIRY 
DISTRICT LEVEL 



en 

M o 
>* a: 



V5 

(d O 

>* a: 



IS: 3934f 
3:2.4.5 



IS : 393Ab 
3:2.4.1 



r. ii-1 



ERIC 



1.2-2 



1.2-3 



S election of Program Participants 

Frogras participants were selected 
according to requirei&enLs for the 

^.following programs: . 

Title I and EDY (SB 90) - . , . . . 

The school district has on filt a 
list of participating students »a 11 
of whom scored bellow Q2 on a stan- 
di f'<ized test. These participants 
were chosen with priority going to 
students v}io fall fn one or both 
of the fclloving categories: 

Ca) Students who scored below 
the twenty-fifth percentile 
on a standardized test 



(b) Students who have serious 
deficiencies in verbal 
functioning because of 
linguistic, social, cul-, 
tUTal, or econoroic Iso la- 
t ion 

Mill ,r-Unruh . v 



(a) Participants in ths Miller- 
Unruh program (K-3 only) 
were selected with priority 
given to students with the 
greatest educational need ^ 
as determined by standard- 
ized achievement tests. ^ . 



ECE 



<a) Every^^hild enrolled in the 
participating grades of a 
participating ECE school 
receives services. ... 



(b) The ECE participants receiv- 
ing $63 abov-e the basic 
grant are' those who scored 
below Ql on a standardized 
achievement test in reading 
and math or pupils who have 
sserlous deficiencies iii or- 
bal functioning. . . . 



DA 



"1 



souRcr 



V 



I 

\ 

ponrrs of inquiry 



DISTFICT LEVEL 



PR 1:7 (FY 1074-75) 



AREA 1* TOPIC rrrfthensi p>^oct>-r> 



SOURCrS OF INFORMATION 

1 ProRran Director ^< Appllc«Ttion 

2. Businoar Manager 5. Planning Procfucts 

3^ DAC , 6. Evaluator 



AfTHORITY 
KEA /SECTION 



lF:U6.18b 
IS: 3927 

3:1.2 



3:2.2 



3:1.2 



ERIC 



POINTS GF IMQUIR" 
DISTRICT LEVEL 



to 














0 








c 


>« 






4^ 


>« 


z 



1 . 3 



Needs Asbcssnient 

The distritt^levf'l needs assess- 
ment is a compilation of school 
leveL data and- Is on file at the 
district office. The needs 
assessment Includes, but is r.ot, 
llmitfd^o, the following 
ca'tegories: . 



1.3-1 



1.3-2 



Base line data on school popu- 
lation showing:* . • • • • 



(a) The number of studenti 
in the school . . . . 



(b) The ethnic and socio- 
economic makeup uf 
studeat population . . . 

(c) The number of students 
with English as a 
second language . . .: . 

(d) The transiency rates of 
s t u d C' r. t s . 



(e) The number of exceotlonal 
students, physically 
handicapped, mentally 
handicapped, and gl'ftfed... 

(f) The nature and effect of 
student background and 
factors such as cultural 
opportunities, travel, and 

* the community environ- 
ment • • 

(ft) The student health data.. 

Ability (or 'achievenent ^ data 
f the' stu''ent population, in- 
cluding: . '. > 

(a) Summaries of diaftnostir 

data for the student pop- 
ulation iro available . • . 

( b ) A c h i e V e r.e n t data are 

.1 V a i 1 a b 1 0 , i n c 1 u (i 1 n R what- 
ever performance measure? 
are employed a h e 
school'. '. 



0; 
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POINTS OF INQUIRY 



DISTFICT LEVEL 



PR 127 (FY 1974-75) 



1. 
2 , 

3. 



AREA 1.0 TOPIC_ 



^SOURCES OF INFORMATION 

Program Director A. 

Business Manager 3. 

DAC 6, 



Comnrefagnal Prngrun 

Planning? 



Application 
Plannihg Products 
Eva lua t o r 



AUTHORITY 
KEY/SECTION 



POINTS OF INQUIRY 
DISTRICT LEVEL 



>* 



o 



U3 



SOURCE 



Gjiitle II 



i.X-3 



1.3-4 



I.3V5 



\ 



1.3-6 



1.3-7 



1.3-8 



1.3-9 



3 . 3-10 



Summary data on affective area 
of student development .... 

Summary dat a on psychomotor 
area of student deve lopment 

Appraisal of the level of 
social and cultural understand- 
Ingof students 



Appraisal of the degree to 
vwhich the present instructional 
program provides diagnostic/ 
prescriptive instruction for 
students on individualized 
basis • • 



Appraisal of health and social 
services available to students 
both wfthin and outside the 
school program 



Appraisal \)f staff needs . . . 

Appraisal ^f the nature and 
epctent of parent involvement in 
prpgram planning and implemen- 
tation »along with parent educa- 
tion opportunities . . . ... . 

Appraisal of the need of li- 
brary materials (print tfjd and 
nou'printed) to be obtained' 
from Title II funds . - . . v . 



J... 



ERIC 



\ 



1)6 



POINTS OF INOtJIRY 



, DISTRICT LEVEL 



PR 127 (FY 1974-75) 



AREA ^_ g TOPIC Conprehe^nf^l v«* Prnm^j^ 
Planning 



SOURCES OF INFORMATION 

1. Program Director ^. Application 

2. Business Manager 5. Planning Products 

3 . DAC ' 6 . Evaluator 



AUTHORITY 
KEY/SECTION 



IS: 3928 
3:1.3 

2,3 



4- 



POINTS OF IMtJUIRY 
DISTRICT LEVEL 



to 

w o 
>* z 



U3 Q 



1.4 



1.4-1 



Program Goal Statemen ts are com- 
plete as follows : 

O 

The district has prepare,d pro- 
gram goal statementr; relate d| 
but not limited f to tlie follow- 
ing areas , ■ 



3:2.3 

1F:116.17,2 
IV 

IS: 3928 
3:1. 3. A 



ERIC 



1.4-2 



1.4-3 



(a) Language development . . 

(b) Reading 

( c ) Ma^hema t Ic s' 

(d) Multicultural 

(e) Staff development . a 

(f) Parent participation and 
i:ommunity involvement 

(g) Parfent education .... 

(h) Health/auJtiliary ser- 
vices . . A 



(i) Bilingual/ Crosse ultural 
(if required) . . . 

The district goals have been 
reaffirmed or revised during the 
past three years 



The goals have been assigned a 
priority rank according to the 
needs assessment 



r)7 



Ui O 



V) 

U] o 



Z4 vs 
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POINTS OF INQUIRY 



DISTRICT LEVEL- 



PR 127 (FY 1974-75) 



2. 



AREA 1 . 0 TOPIC Comcr^hensive Pro^r nw 
Planning 

SOURCES OF INFORMATION 



Program Director 
Business Manager 



3., DAC 



^■4. Ap plication 
$. Planning Products 
6 . Evaluator 



AUTHORITY 
KEY/SECTION 



POINTS OF INQUIRY 
», DISTRICT LEVEL 



M O 



SOURCE 



IF: 116. 17b 
1S:3928 

IF: 117. I7b 
IS: 3928 



3:1.3 



IF: 116.24a 

IS: 3926 

3:U4 
3:2. A 



ERLC 



1.5 
1.5-1 

1.5-2 
1.5-3 



1.6 
1,6-1 



Progratn'Components and Objectives .^ . 

Each objective Is related to the 
needs assessment. . * 



303 



Each object Ive description In- 
cludes specific performance (end 
product) objectives. . . . ^. . , 



Each of the stated objectives Is 
complete in content, Including the 
following: . . . . < . V . « . • 

(a) That which is to be known 
or done 



( b ) By whom .......... 

(p) Under what conditions v 
(d) When 



(e) How achievement Is to be 
measu red 



(f) Mini mum level to be 
achieved 



Identification and Use of Resources 



The dist.rlct fulfilled the re- 
quirements for the identification 
of resources In planning and lir^le- 
menting the consolidated program,, 
Including the followlig: . < . . . 



(a) Resources available from 
local taxes and state 
apportionments , . • 

(b) State resources available 
by f o rmu la or entitle- 
nient . . r 

(c) Federal resources avail- 
able by formula or entltle- 
men^" 



(d) State and federal resources 
available on a compe 1 1 1 i ve 
basis. , . . .... . 



D8 
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POINTS OF INQUIRY 



DISTFJCT LEVEL 



PR 127 (FY 1974-75) 



1 . 
'2 . 

3.. 



SOURCES 
Program Director 
Business s Manager 
DAC 



OF 



AREA^ 

NFOPMATION 
A. 
5. 
6. 



TOPIC 



i'orr.prehensi.ve Frogr ar 
Planning 



At'plicatlon 
Planning Products 
Eva 1 ua tor 



AUTHORITY 
KEY/SECVrOK 


POINTS OF INQUIRY 
DISTRICT LEVEL 


w ^ > • 
ui 0 
>• ss 


t/3 

Ui 0 
>• 2= 


w • 

ui 0 
>• z 


w 0 


SOURCE 


r 


"1.6-1 (cont.) • ^ ' \ .} 
<e) Persons and business 

^* e s t ab 1 i shme n t s in the •* ♦ 





! 



district whicji can offer 
^assistance ^or^learning 
opportunities to stu- 
dents . • . • 

(f) Health and social- 
service agencies, . . . , 



1.7 



(g) Various buildings and 
other l9cations (such 
. as museums and arboretums) 
which have educational 
va l,ue * 

Min imum -arnd Maximum Levels of 
Service? . . ^ .^. • 



The requirements for minimum and 
maximum level^s of service have been 
maintained a6 follows: . . . • 

(a) By participant priority for 
providing additional ser- • 
vires to eligibfe pre-school 
and el %men ta ry students 
first . . . • 

(b) By the maintenance of expen- 
1^, ditures per public school 

* pupil of between $350 and 

$550* 



This interpretation has been agreed to via 
waiver/ ^The actual statement In Title 5 
Is included below for the convenience of 
the reader*. 

3932 "For each student receiving services 
under ESEA, Title I or the EDY Program, 
the district shall verify a minimum allo- 
cation from combined categorical funds of 
50 percent of the average per student ex- 
penditure excluding categorical funds In 
elementary schools In California. Total 
categorical aid funds allocated for each 
student shal^ not excee'd 80 percent of 
this cove rage.'* 



/ 



1.8 (Not applicable d 1 /t rj/c t level) f 
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POItlTS OF INQUIRY 



i I 



DISTF ICT LEVEL 



PR 127 (FY 1974-75) 



AREA I • ^ TPriC Cor;prehens i ve Progr am 



SOURCES OF INFORMATION 



?1 ariT. i ng 



1 . Program D i rec tor 

2. ' Business Ifan^gcr 
3.. 'daC 



A , Appllcat ion 

5. Planning Products 

6 . Eva 1 ua t o r 



AUTHORITY 
KEY/Sr.CTION 



ERIC 



IK: lU. 16. 9 

<i 

IS: 3942 
4: p 1 

IF: 116. 19a 
IS: 3943 



4:p 



IF: 1 16. 19b 
IS : 3942 



ir: 1 16. 101) 

3942 
4;p 1^ 

IF: 116. I9e 

3:p 2 



IF: 116.. I9e 
4:p 2 



IF:- I 16. 1 9c 



IF:- 116. 19b 
1 S J' i930c 
):^1 .J(6) 



POINTS OF INQUIRY 
DISTRICT LCVEL 



CO 

u; o 



U3 



soiKci: 



1 . 9 Noupubl i c/Nonprof t t School 
Part ic tpa t ton 

Required provisions were made for 
the participation of pupils in 
!* P / P * . 

Individuals knowledgeable of the 
assessed needs of KP,MPS children 
were lnv»lA;cd in the planning 
p roce^s.^ . . . . 



1.9-1 



I. 9-i 



1.9-3 



i.9-.4 



1 



1 . 9-6 



1.9-7 



1. 9-fi 



1.9-9 



1.9-10 



Participating NJJiPS students 
live in or live reasonably 
coterminous to the tnrget aVea. 

Tlie criteria for t ion of 

paij-tic ipants of NP/^PS are com-= 
parable to the KDY criteria used 
for tlie selection of public 
school participants. . , . , , 



Siigibie A^'/UPV, children 
are provided activi>ties which 
are comparable to those providjed 
public qchool participants,. . . 



•The 5 p'c clal'nccHT of ollf»iKl« 
NPNPS pupils were considered 
In planning program activities. 

All funds supporting partici- 
pants of NPIJP.S children are 
under the control of the public 
s c hoo 1 . . V . »^ . . . ... . . 

(Not npplicablci^t district 
level) 

Project staff serving at NPNPS"" * 
sites is under administrative 
control of the public schoo-l 
staff.*.. 

^^ocessary Equipment for use of 
project participants is assigned 
to the NPfJPS site only for tho 
duration of the project.. . . . . 

Parents of pa r t i c 1 pa t irvfe NPflPS 
vhildrtMi J ml r o p r o se^i t a t Lvo 
NPtiPS staf f members a^e .serving 
on the District Advisory Com- 
m i 1 1 e e . . . • ,. . , . . . .. ', , 



f 



I) 10 




POINTS OF INQUIRY . 



DISTRICT LEVEL 



PR 127 (FY 1974-75) 



AREA I * 0 TOPIC "r nprehenaivfi Pro/^jr 
rianr. ir.g 

SOURCnS OF INFORMATION* 



1. Program Director 

2. Business ffan«ger 

3 . DAC 



4. ApplicacioA 
*i 5. Planning Products 
♦ 6. Evaluator 



AUTHORITY 
KEY/SnCTICN 



HEW: Regula- 
tions 

; 

A:p 2 
6:p 6 



5F; 116. 3 



5F: 116. 3 
4:p 2 



4:p 2 



ERIC 



POINTS OF INQUIRV 
DISTRICT LEVEL 









CO 




to 




V) 






Ui 


o 


u 


o 


u 


o 




o 






2 


>^ 


:c 




z 


>• 





1 . 9 
1.9- 

1.9-i 



1.9-13 

1. 9-14 
1.9-15 
1.9-16 

1.9-17 
1.9-18 

1. 9-19 

V 

1. 9-20 



(cont . ) 
11 



1. 9-2b- 



1.9-22 



(Kot applicable at district ^ 
level) 

Tl.e NF/IPS has filed HEW F/orm 
UU\ (Civil Rights Act of 1964) 
with' the USOE. 



A list of participants at 'iip/rjps 
has been provided to the public 
school administrator. ..... 



(Not applicable at district 
level) 

(Not applicable at district 
level) 

Materials purchased with Tittle 
II funds are in compliance with 
the materials selection policy 
of local public educational 
agencies . , 



(Not applicable at district 
level) 

Title IT wotcrlalo are tn-h^n^- 
fit private schoo 1. ch 1 1 dr en and 
teachers, and are on a loan 
baslsonly. .. .^ 



NP^PS has budgeted an amount for 
library resources (not Including 
Title II resources) this year 
equal to or greater than la'st 
year's school ^4)rogra^l. .-. .' . \ 

NIVNPS officials were Included in 
the development of the fQllowing; 

(a) Needs Assessment . . . .« 

(b) Goals . 



(c) Fupil Selection Criteria 
(Title I only) ..... 

(d) ProffamPlanning . . • . 

^e) Program F. valuation . . . 

(Not applicable at district 
1 eve 1 ) 

(Not applicable at district 
level ) 

01 I 
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INTS OF INQUIRY 



DISTIICT LEVEL 
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AREA 2.0 TOPIC Maintenance of 



Exlork 



SOl'Krri OF INFORMATION 



Program Director 
Business Manager 



A. Application 

5. Planning Products 

6. E^aluator 



AUTHORITY 
KEY/Sr.CTION 



!F:n6.17 h 
IS: 3937 n 

lF:U6.45(b) 

!F;n7.3 
IF:U7. J 



!S:3937 



!S:6A99.23l 



0, 



POINTS OF INQUIRV 
DISTRICT LEVEL 







v> 




VI 




Ui 


o 




O 




o 


>• 




>* 


2 


>> 


z 



2.0 



2.0-1 



2.0-2 



,0-3 



2.0-^ 



.0-5 



MAINTLNAN'CE OF EFFORT 

Maintenance of effort is evidenced by 
the following criteria: .... . . 



The stm of local and state apportion- 
ments per student participant is not 
less than 95*. of the previous year's 
expenditure * 



An assurance of compliance has been 
signed « . . . . 



The district has budgeted an amount 
(not Including Title II resources) 
for library resources this year equal 
to or greater than each of the two 
previous years 



The district is niaintainlng the fiscal 
effort at least equal to that of the 
elementary child not participating in 
the ECE program 



District funds have not been supplanted 
by SB 90 EDY funds 



1)1 . 



sorncE 



POINTS OF UJQIJIRY 



DISTF ICT LEVEL 
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1 . 
2. 
3. 



AREA 



SOURCKS OF INFORMA; ION 



TOPIC 



Comnunltv I .i vo 1 viti- nt 



Prograrr. Director 
Business Manager 
UAC 



A. APt>llcation 

5. Planning Products 

6 . Evaluator 



AUTHORITY 

KEY/sncTior: 



IF: n^. 17(0) 
IS: 3930.0 



IK: 110.17(0) 
1 i 

ir:lH>.l7(0) 
1 li 



IS£3930 b 
1F:116.17(0) 

2 1 
IS: 3930 c 

3:1.1 



4 : Ad<l<'ntiti.*n 



ERIC 



' 3.0 PARKNT & COm-NlTY INVOLVKMF.NT 

The program provides foi the required 
parent and community involvewentf as 
evidenced by the following criteria: , 



POINTS OF INQUIR'.' 
DISTRICT LEVEL 







to 




to 
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O 




o 




o . 


>- 
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>• 


2 


>* 


a: 



i/i 

ui O 



3.0-1 

3.0-2 
3.0-3 

3.0-/* 

3.0-5 
3.0-6 

3.0-7 



There is a functioning District Advisory 
Committee 



(Not applicable at district level) % 

The application describes how parents 
were involve<i ^n planning the piogram . . 

Th«» application outlines specific pKins 
for continued Involvement in development^ 
operation, ^nd evaluation in the programs . 

(Not applicable at district -level) 

Tarcnts of nonpublic school participants 
are on the DAC 



/ 

Kach district has Vhe following DAC 
products uival 1 able : 

(a) Membership and Composition 

Alternative DAC structure . . 
— Joint Committee 
— Co-comttittee 

(b) Organizational responsibility . 

District employee (name and title) 
responsible fpr organizing DAC 

<c) Membership. . . a 

Mcsnbership list (name, address, 
and phone number) 



Note: 



(d) Coirposltlon . . . . ^ • • • • 
(l)'More than a simple majority 
of participating members (not 
employed by the scijool district)] 
of participating cM>dren. . L 

In dl<5trlcts In which tht»rc is 
a high concentration of FDY 
participants, parentJi (net 
eroploved by the district) of 
f-rogram partlclp*»t-r«; rr^nposo 
more than d rrajorlty of tSu* OAC 
ncmbersitip . 



1)1 1 



SOiK( I. 
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POINTS OF INQUIRY 



DISTUCT LEVEL 



PR 127 (FY 1974. 7S) 



AREA 3."> TOPIC 3.0 Parent 'aod 

Community Involvement 

SOl*H(,KS OF INFORMATTQN 



1 . Prograrj t)i rector 

2. Business Manager 

3. DAC 



4. Application 

5. Planning Products 

6 . Evaluator 



3:1.1.1 



AL'THORITY 




POINTS OF INQUIR-; 
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SOURCE 


KEY/SnCTlON 




DISTRICT LEVEL 




>* as 


>• ac 


>• :^ 



1:1.1. 
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3.0-7 ((:ont . ) 

^ (2) Reflects ethnic and socio- • 
economic composition with- ^ 
< ' i n t he c omoun i t.y . . . . |_ 

(3) Includes parents of students^ 
in all aRe spans . . . .> ; 

(4) Includes fevels funded by | 

r.cc 

(5) Includes representatives 
from non-public school, 
coflimunlty, and foclal ser- , 
vice agencies , . . . ^ 

(6) Includes representatives 
frt>n the business cotninu* 

n Ity 

(7) Includes classified aides, 
teacher assistants, or 

other support personnel . . ^ 

(8) Includes teachers and ad- 
minlKtrator«* (mn«r Inrlude 
representation from the 

ECE funded grades) . . . ^ 

(9) Includes representatives 
from participating non- 
public schools 

(f) A. l*jtlger recording changes 

1 n member ship . 

(f) A schedule and content de- 
scription of DAC trjir.ing 
tictivitles 

( R ) A c h e d u 1 e of dates and 

locations of DAC meetings . . 

\ (h) A description of connunl- 
c a t J o n channels used to 
provide lnfx)rmatlon to the 

DAC 
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( 



1 . 

2. 



AREA 3. TOPIC Parent and 

fommun i t v Invo 1 vement 



f^SOlR{Ki OF INFORMATION 

Program Director . Application 

Business Manager ; 5. Planning Produces 

>Di\C 6. Evaluator 



:<Ev/s:,CTiON 



2 i i 



1F:115. l7o 

2 V 
J i , I . i . 4 



IF:. i7i 
? I T 



:F;'n6. 17o 
2 V I i 



1:116. 17o 

J , I J I 
^ : A (I cU» n <! M m 
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3.0-7 (cont . ) 



(i) A description of communica- 
tion chaiviels used by the 
DAC for bringing recommenda- 
tions into Che decision- 
raking process ...... 

(]) A record of the major recom- 
mendations made or endorsed 
by the Comrrittee in each 
step of the planning process 



SOl'Kfl. 



1 , f ) - P. 



ail' r.imher oi' nA(* ha^s been fui- 
nishL'd, free of x;J)/^rge, copies of 
fecteral regulations, guidelines, 
ftntf' rt»gulntion.s, evaluation re- 
p/.)rts, and other information need- 
ed in planning,' developing^and 
or>erntit\g the project, . . . . . . 

3vO-9 The program includes specific pro- 
visions for informing and counsel- 
ing with parents concerning ser- 
vices to be provided' their children. 

;,C''l'' i"^C Advlijory Cv>mmittee was involved 
m making recommendat ion*^ about the 
/ 1 low ing :♦ . . . . • . • • • • • 



(a) Establishment of a timeline 
for development of the dis- 
trict master plan (ECE> , . 

(h) Needs assV^sment on a school- 
by - s c h o o 1 basis . K 



(c) C,oaL^ and objectives 

( d ) E va 1 iia t i on 



(p) Sl:aff .development^ — * . 

(f) Parent participation 

( K ) r.i r en t e<iut a t 1 on . 

(h) Application for fundj 



4- 



Ci) Ident i f IcU ion of conmunitv< 
resources 
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I. 



AREA 3.C TOPIC 



Fa rent and 



SOURCES OF INTORMATION 

Program Director ' A. 
Business Manager * 5. 
DAC >v ■ ' 6 . 



Community Involvement 



Appl Ication 
Planning Products 
Evaluat or 



AUTHORITY 
KEY/SECTION 



IF: 116. 17o 

2 vii 
4:p 2 



3:2.1.3 



3 : Addendum 
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SuLK'CE 



3.O7IO (cont.) 

* • (j) Recommendation as to which 

schools to include in each 1^ 

phase (£CE) L 

(k) Health assessment |_ 

3.0-11* The LEA has" adequate procedures 

.to irfsure prompt response to com- 
plaints and suggestions from par- 
•ents and advisory groups (See 
also A127-S, page 2) • 

3.0-12 Assurances have been signod by 

DAC/SAC chairmen tha^ the commit- 
tees have been involv*?d in all 
phases of planning the program 
and will be included in all phases 
of program imp letcentat i on 

3.0-13 If the district has established 

^ddition^l committees, an assurance 
has been signed by the chairman of 
each committee stating that the 
committee has: 

(a) porticipatwd fullv In rh*» ^ 
planning process 

(b) brouijn* its recor.ner.dat ic r. £: 
to the school advL:;ory con- 
Sittee 
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AREA 



Tonc 



n i g.«;finl nation 



of I nf o Hlfa t ion 

solrcks of isfokmation 

1 Program Director A. Application 

2. BasinessMonager 5. Planning Products 

3 . DAC ' " 6. EvaXuator 



AUTHORITY 
KEV/SECTION 
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DISTRICT LEVEL 



o 



o 
z 



IF: 116.17 



IF: 116. 25a 



4.0 



4.0-1 



.0-2 



IF: 1 16. 25b 



4.0-3 



DISSEMINATION OF INPORMATTON 

Information is being d i s>seni ina t ed 
as required. 



The school district is foil owing 
its approved plan for dissemina- 
tion of information to parents*^ 
and community. . . ... . . . . - . 



The district is following an ap- 
proved plan for the dissemina- 
tion to teachers and administra- 
tors of the significant develop- 
ments and experiments^in educa- 
tion. 



The district has a pi an to dis- 
seminate promising educational 
practices developed in its proj- 
ect to other schools for repli- 
cation whe re feasible 
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AREA 5.0 TGPIC_ 



Evalua t i-on 



SOURCE > OF INFORMATION 
1. P,rogram Director'^ ^. Application 



2. Business Manager 

3. : DAC 



5. Planning Products 
6 . Eva 1 ua to r 



AUTHORITY 
KEY/SECTIOri 



IF: 116. 22d, 
b.c 

IS: 392y 

3:1. 3. 3 



9;ECE p. 11 
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U3 



5.0 
5.0-1 



3:1.3.3 



3:1.3.3 



9:Page 11 

3:1. 3. 3 
9:Page 11 



IF: 116. 23 
9: Page 11 
3;2./3. 3 



9:Page 11 
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5.0-2 



EVALUATION 



The district 4ias oh fil« an eval- 
uation design which Includes the 
following: . . . . . . % . . t. « 



^a) Clearly stated, me as ur able 
performance tend product) 
objectives . . . . . • 

(b) Clearly defined activities 
for meeting performance 
objectives - 

(c) Instruments for prei/post- 
testinp* includlne 
behavioral change 
assessment . . 



(d) Analysis design tO'Show to what 
degree the program objectives 
were achieved 



(e) .dissemination plan 



The planned evaluation program 
is being lraplemented>as evi- 
denced by: . . . V 



(a) The evaluation activities 
r e c o r d'e d and up to date 

(cr) B^se llne (pre-test) aata 
collected, recorded, and 
analyzed . • 

(c) Process evaluation data 
(activLt les) collected, re- 
corded, and analyzed . . . 

(d) Last year's evaluation re- 
port findings disseminated 
in understandable language 
to staff, parents, and com- 
murvlty; in addition, the 
state evaluation report is 
made available • • • • < • 

i,e) Current program process 

evaluation disseminated to 
staff . 
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AREA 6.0 TOPIC 



Fiscal and Admin- 



' ' — — istratlon 
SOURCES OF INFORMATION 

1.. Program Director * 4. Application 

2. ! Business Manager 5. Planning Pr.od^cts 

3, DAC ^ Evaluator 



AUTHORITY 
KEY/SECTION 



IF: 13 6.23 
lS:394a 



1S:')943 
l-F : 1 1 6 . 1 7 n 



lF:100b.. i;7 
5: Page 6 
3. A 

lF:100b. 215 
(d) 
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6. 0-1 



6. 0-2 



6.0-3 



6. .0-4 
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00 

Ui o 



Ui O 
>- 2 



o 



FISCAL AND ADMINISTRATION 

The district has complied with 
the fiscal administrative re- , 
quirements indicated below:^ . . 



The district developed autdlt- 
able records Which identify 
expenditures by funding source 
(See A-127, page 17) 



Jhe Business Office submits 
^"periodic fiscal reports to the 
DAC, Project Director, and 
other administrators for 
proper operation of the project 

Records are retained for a 
minimum of three years after 
close of fiscal year 



An inventor]^ of all equipment 
costing over $200 Is maintainedi 
and includes the following in- 
formation: ' 



(a) A description of the 
property . . . . • 



(b) The Identifying serial 
number . 



(c) The project number . . 

(d) The date purchased . 

(e) The acquisition cost 

({) The vendor or source of 
property . 



(g) Ihe percentage of federal 
fuitds used In purchase of 
the I o p e r t y . . • k • • 



(h) The location, use, and 
condition of proper oy . 



(1) The tlm-e anc mode of dis- 
position of all property 
that has been transferred 
to other projects or that 
has been sold . . . *, 
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sol R{/.S 
Propra* Director 
Business Manager 
DAC 



OF 



INFORMAI I {^N 
U . 
5. 
6., 



TOPIC 



Fiscal and Admin 



1 s c r a t Ion 



Application 
Planning Products 
Evalu.Ttor 



AUTHORITY 
KCY/SLCTIO:. 



IF: 116. 1 7h 
lib. 20 
lOOb 2 in, 
i\l 

l:TlLle 5 

IS CEC:3940, 
o4A5. 16 » 
19 

H:Tltle II ' 
1F:117.12 



IF^-lOOh. 2 50 
lF:100b. 217 
If: 100b. 218 



ERJC 



6.0- 



b. 



POINTS or INQUIR" 
DISTRICT LEVEL 



















ui 


c 




o 


' >* 




>* 




>* 


2: 



u: o 



Equipment ajid other capital out- 
lay items purchased with con- 
solidated application program 
funds meet the following re-,^ 
q u i r emen r s : v 

(a) The it;em is necessary in 
terms of implementing the 
consolidated program . 

(b) The item will have a bene- 
ficial effect on the 
achievement of program 
participants . . . . 

( c ) Title I equ lp.men t has been 
labeled with the following 
i n f o r ma t i on ; 

(1) KSEA, Title I .... 

(2) Month and year of 
purchase (only if 
purchased after 
June, 1972 ) 



(d) 



Each item purchased with < 
Title tr funds is stamned* 
as Title TI or otnerwise 
Identified' as property of 
t h e d i s t r i c t . . . . . . 

An inventory of all Title II 
materials acquired is 
available 



District administrators are 
aware of federal regulations 
concerning coaflict of inter- 
est» copvrigfitstand patents 
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6, 0 
AREA 7 ,0 



TOPIC 



Fiscal and Admin 
Management Plan 
frogram Ues ign 



'SOURCF<? OF INFORMATION 

1. Program Director A. Application ' 

2. Business Manager 5, Planning Products 

3 . DAC 6 . Evaluator 



AUTHORITY 
KEY/SECTION 



POINTS OF INQUIRY 
DISTRICT LEVEL 



CO 

ux o 



SOl'RC! 



6:Page IB 
IS CEC: 

3599,. 3 
IS CEC: 

6445.16.19 
IS CEC: 

6AA9.236 
IS CEC: » 

6449,237 
IS CEC: 

39A3«,b 



6.0-7 



3:2.6 



7.0 



8.0 
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The district has adequate docu~ 
mented procedures to assure com- 
pllance wlt;h each of the follow- 
ing activities . . . \ .... 



(a) 



(b) 



Salaries charged to the pro- 
gram are directly relate^ to 
the consolidated application 
activities . 

Progrira servilfces are providedj 
to prog ram participants only . 



(c) 'Employees who are assigned 
part-time to more than one 
program have had their sala- 
ries prorated accordingly to 
the time spent in each < • • 



MANAGEMENT PLAN 

The LEA has a progVam management 
plan 



PROGRAM DESIGN 



(Not applicable at District Level) 
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AREA 9.0 TOPIC 



ECE Special 



Requ Iretnent s 



SOURCi:S OF INFORMATI.ON . 

1. Program Director • Application 

2. Business Manager 5. Planning Products 

3. DAC 6. Evaluator 
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AUTHORITY 
KEV/SCCTION 
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9.0 



9.0-1 



ECE SPECIAL REQUIREMENTS 



The district 
Ing required 
and there is ; 



has met 
fund ing 



the'' f ollow- 
criteria 



(a) Evidence that parents and 
the communi ty haw been 
actively Involved in de- 
veloping the plan sub- 
mitted and are continuing 
to be invo Ived in t he s ub- 
sequent^ imp lenen ta t ion » 
evaluat ion ,and modi f Ica- 
tlon of the prog ram . . . 



(b) 



Evidence of utilizing and 
maximiz ing existing cate- 
gorical aid fjinds available 
to serve K-l'children anrf 
children In day care, pre- 
school* and extended day care; 
and the re a re carefully de- 
veloped plans for articula- 
tion, both for the children 
covered and for their parents 



(c) Evidence that the district 
has provided for mobilizing 
and utilising all available 
school and community re- 
• sources to assure the de- 
livery of the necessary 
health, social work, and . 
nutrition services 



(d) 



Evidence of a creative, 
carefully designed approach 
to strengthening or re- 
structuring the existing 
K-J program based on a care- 
ful needs assessment . . . . 



(e ) Evidence of the implementa- 
tion of a specific plan for 
evaluating program activi- 
ties • 



(f ) 



Evidence of an awareness of 
the necessity for staff to 
adequately understand and 
meet the needs of all cnll- 
dren, especially those of a 
racial and /or ethnic back- 
ground wLlch is different 
from that of the staff . . . 
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1 . 
2. 
3. 



AREA 9.0 TOPIC 



ECt Special 



Requirements 



SOURCES OF INFORMATTf N-? 
Program Director Application 
Business Manager 5. Planning Products 

DAC 6 . Eva lua t or 



AUTHORITY 
KEV/SnCTION 



CEC 9: . 
6445. 3 
: t' a g e 4 
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9.0-2 The district has d^eveloped a 

, program designed to systemati- 

cally phase into the program 
all the schools in the district 
in no more than 5 years. .... . . 



(a) 



This plan designates 
which school or schools 
will be included in 
phase one (1973-74 ) , 
phase two (1974-75) , etc , 
for all schools serving 
students 



ERJC 



(b) The district has devel- 
oped criteria for the 
systematic inclusion of 
the schools in the phase- 
in process 



1)2 J 



3;^ 
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1. 
2. 
3. 



AREA 10.0 TOPIC 



BlllnKual/Cro«<» 



SOURCES OF INFORMATION 

Program Director 4. 

Business Manager 5. 

DAC ' 6. 



cultural 



Application 
Planning Products 
Evalua t or 



AUTHORITY 
KE'/SECTION 
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10: AB2284 
ft 

IS-: 3927 



10.0, BILINGUAL/CRgSSCULTURAL 

10.0-1 Nteds Assessment^ 

The school district has taken an 
annual census not later than 
March 1 and reports to SDE by 
April 1 In two categories: . . . . 



(a) Number of children within 
school district with lim- 
ited Engl Ish-s peaking 
ability, classified by 
p r Ima ry 1 anguage'' . . . < 



10.0-2 



(b) Number of children who 
are non-En^llsh -speaking 

The following products have been 
developed iby the participating 
school district:, 



(a) The school district has ' 
on file a project wnlch 
provides the following 
^ Inf ormat Ion : 



(1) 



IHent i f IpH ena 1 s 
for bilingual educa- 
tionias determined 
by the local needs 
assessment < . . 



(2) Activities designed 
to provide the fol- 
lowing: 



ERIC 
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-development of com^ 
petence In two lan- 
guages for all par- 
clpatlng pupils 

-positive reinfor ce- 
ment of the self 
image of part lei- 
patlng children 

development of in- 
tergroup and Inter- 
' cultural awareness 
among pupils, parents 
and the staff 
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AREA 10.0 TOPIC^ 



SOURCES JSV(^p^kT^()^ 

1 Program Director A. 

2.. Business Manager 5. 

3. DAC 6. 



BiHngual/CrQita. 



Appl icat ion 
Planning Products 
Eva luat o r 



"AUTHORITY 
KEY/SECTION 



IS: 3936 



IS : 3929 
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10.0-2 (cont.) 

(b) 



the district is inplenent- 
Ing « o^anagenent plan to 
organize, coordinate, and 
monitor with distinctly 
outltned plans that will 
ensure success In the bi- 
lingual program* 



(c) 



The district Is Implement- 
Ing a plan for teacher and 
aide pre service training 
which will identify and im- 
prove knowledge levels of 
each teacher and aide in 
teaching methodology, bi- 
lingual philosophy, and 
education. 



(d) The district is implement- 
ing a plan for the gradual 
assumption of the costs of 
the bilingual program by 
the district 



(e) The district is implement- 
InR mn li\«prv<r* frainins 
program for teachers and 
•aides that is linked with a 
nearby institution of higher 
educat ion 



10.0-3 Ins t rue Hon 



The participating school district 
has an articulated sequent ial pro- 
gram of instruction in bilingual 
education designed to develop 
competence in English and In {he 
primary language of the limited 
English-speaking participants. . . 



10.0-4 Evaluation 



(a) The district has evaluated 
each child to be placed In 
a bilingual program, assess- 
ing his strengths and weak- 
nesses in English and in 
the second language of in- 
struction r 
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AREA 1 p . Q TOPIC_ 



aiHn»ual/Croa«< 



cultural 



SOURCES OF INFORMATION 

1.^ Prograa Director ^ tj 

2 . .> Business Manager 5. 

3. DAC 6. 



Applicadon 
Planning Products 
Eva lua t or 



AUTHORITY 
KEY/SECTION 
\ 
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10.0-4 



:ont . ) 



(b) The district has estab- 
lished a plan for evalua- 
tion of the children's 
progress* Including, but 
not limited Co, reading 
c otap rehenslon and speak- 
Ing skills in English 
and the second language 
o f instruction . . ... , . 



10.0-5 



10.0-6 



District Advisory Committee 
Part icipation 

The district has established 
a dlstrictwlde advlso r y commi t - 
(ee in which parents (not em- 
ployed by the district) of par- 
ticipating students constitute 
more than a simple majority, or 
has designated an existing district- 
wide advl sory^s tructure in which 
ouch parents constitute more than 

a simple majority 

• f 

All teachers teaching classes 

X unded t hrou^^h thi<-, ''•jrislatlon are 

b 1 1 Ingual teachers 



"Bilingual Teacher" means a teacher fluenf\ln both English and the 
primary language of the limited-English-speaking pupils in a bi- 
lingual program. Such a teacher need not be certificated to teach 
In both languages and may be exempted from other certification re- 
quirements as set out in Section 5764 of tne California Kd^cation 

California Education Code 5764 » as paraphrased^ establishes the following: j 
A waiver af certification requirements for bilingual teachers,, or fw^ 
authorization to use for two years only a monolingual teacher and a 
bilingual aide or aides, may be requested from the Superintendent o( 
Public Instruction. However, a diligent search In California by 
the district with assistance from SDE should be conducted to re- 
cruit bilingual teachers, before submission of a waiver or ^othorl 
iat ion* request . ^ 



SOURCE 
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CONSOLIDATED PROGRAM 
PR-127 SCHOOL LEVEL 
PROGRAM REVIEW - POINTS OF INQUIRY 



INTRODUCTION f 

The cosbined cooperation of County Superintendents of Education, local educational 
agencies, and the State Department of Education has produced these school level 
points of inquiry. The purpose of this instrument is to assist in the review and 
examination of consolidated programs at the school level for compliance with 
Federal and State Regulations and State DefUrtment of Education policy. ^ 

EXPLANATION OF USE 

X*^ This instrument is primarily designed to be used by a State Department or 
» Education review team. It say be used by schools for self-analy sic , but the 
results are not to be reported tc the State Department of Education. 

Those points of inquiry which are negatively worded are tak^n verbatim from 
regulations. The use of YES/NO answers requires equating with TRUE/FALSE 
answers to reply logically to those* points of inquiry; i*e., if a statement 
is true, mark "YES", if the statement is false, mark "No". 

3. The major levels of inquiry (i.e., 1.0, 2.0, etc.) are to be answered by flitft 
answering the 8ub--level points of' inquiry, which are specific questions. One 
or more "NO" answers in the sub-level point of inquiry warrants a "NO" answer 
in the major- level point of inquiry. 

4. ' Us^ of the Bilingual/Crosscul tural section of this *1 nstruQent in determining 

compliance with bilingual requirements is determined by the following: 

«. Schools HAving one or more students whose primary language 
* is not English, but which have fewer than 15 'percent of such 
pupils, must have a locally approved plan for meeting that 
need. In Section 10.0, respond only t\* 10. 0*1. 

b. A school with 15. percent or more .c h i Id ren whose primary language 
is not English must have a B i ling ua 1 /Cros scu 1 tu ral component. 

In Section 10.0, respond only to 10.0-1. 

c. A school which receives AB 2284 bilingual fun.ds must complete 
Section 10.0. 

5. The "Authority Key/Section" column in the Points of Inquiry refers to a speci- 
fic regulation or policy four^ in {.he following official documents;'^ 

Authority Key * 

1. Regulations for Consolidated Categorical Aid Programs (Title 5 and 
Federal)* 

2. Instructions for Completing the C omp rehensi ve School Program Plan 
(A-127S) 

3. Instructions for Comprehens ive Program Planning 

4. Addendum to Instructions for Comprehensive Program Planning (N?S, N&D, 
Co-op) 

5. Management Information and Requirements for Programs Funded through 
A-127 

6. Consolidated Application (A-127) 

7. Manual of Instructions for Completing Consolidated Evaluation Report 

8. Title II State Plans 

9. Policies for Early Childhood Education 
10. AB 2284 ^ 



*1S • State Regulation 
If - Federal Regulation 
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1.0 

1.1 
1.1 

1.3 
1.4 
1.5 
1.6 

1.7 

1.8 
1.9 
1.0 

3.0 
4.0 
5.0 
6.0 
7.0 
9.0 
9.0 

10.0 
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Tuu OF oomrnirs 

SCHOOL LEVEL 
POUfTS OF INQUIRY 

\ 

TOPICS PACE 
CcmpT9timmi^% Progrcoi PiMnlfit SI 

S«l«ctloii of School Attondaaco Arose \ 
(Ibt Appllcoblo ot School L%v«l} 

Soloction of ProgrM Portlclpanto ' SI 

Noodo AOM««Mnt • • S2 

ProgrM Gool StatMonto • < ^ S4 ' 

ProgtM Cotfpoaonto ond Objoctlvo* • S5 

« 

Idontlflcotlom Mid Um of RoMurcos 

(Not Appllcoblo ot School Lovel) ' 

MlfiiaMi ofid Hayli« L«voI« of S«rvlco 
(Not A|>pIicobIo ot School Lovol) 

liolotlon ond Sogrogotlon S6 

Notfipubll^/ Nonprofit School Partlclpotlon ^. • • • S7 

HolntWMice of Siivrt 

(Not Appllcoblo 04 School Lsvol) 

Paront and Co— unity IiivoIv«Mnt ••• SIO 

Oiootaifution of InforMtlon • SI3 

Bvoliiatloii o SI4 

Flocol and Adalniotrotioii • SIS 

ttofugwMQt Ploa • • • ••••••• SIS 

ProgTM Uoslgo ' • • • SI6 

ICE Spoclol Eg(|ulr«Mnto 
(Not Appllcoblo ot School Lovol) 

Bilii«tul/Cro««cttltur«l % 517 
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>R 127 (FY 1974-75) 
ev, 8/14/74 

1, 
2, 
3, 
4. 
5. 



' SOURCES 0/ 
Program Director 
Business Manager 

Teacher*^; 

Aide 

Parent 



INFORHAT'ION 
6, 
7. 
'8'. 
9.-' 
10, 



AREA 1.0 TOPIC Conprehenslve Program 
-* Planning 



Principal 
Resource Person 
School Plan 
Planning Products 
Evaluate r 



AUTHORITY 
KEY/SECTTOM 



lS:3934a 
3:2.4' ' 



POINTS OF INOUIRY 
SCHOOL LEVEL 



s 










J 














1^ 




- 




> • 





lF:lT6,17f 
lS:3934c 
3: 2. A. 3 



lS:3934d 
3:2.4. 3 



3:2.4.3 



lS:3934f 
3:2.4.5 



lS:3934b 
3:2.4.1 



1.0 
1.1 
1.2 



1.2-1 



1 . 2-2 



1.2-3 



COMPREHENSIVE PROGRAM PLANNING 



(Not applicable at school level) 

Selection ot Program Participants 

Program participants wefe selected 
according to requirements^ for the 
foljoving programs: 



Title I and EDY (SB 90) 



The school has on file a list 
of par t i c^4>a t ing students^ all 
of whom Scored below Q2 on a 
standardized test. These p.arti- 
cipants werechosen with priority 
going to students who fall in one 
or both of the following cate- 
gories : 



(a) 



(b) 



Students who scored below 
Ql on a valid standardized 
test 



Students who have serious 
deficiencies in verbal lunr- 
rioninc because of lin- ' 
guistiCy social, cultural, 
01^ economic Isolation . . 



Miller-Unruh 



P a r t i c ijt^Ji-td-^ n the Miller-Unruh 
program (K-3 only) were selected 
with priority given to students 
with the greatest educational 
need as determined by stan- 
dardized achievement tests. 



ECE 



Every child enrolled in thp par- 
ticipating grades of a partici- 
pating school receives ECE ser- 
vices . . . 

The ECE participants receiving 
$65 above the basic grant are 
those* who scored below Q]^ on a 
standardized achievement test In 
reading and math or pupils who 
have serious deficiences ^n ver- 
bal functioning 



ERIC 
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POniTS OF INQUIRY 



.Sr.HOfil LEVEL 



PR 127 (FY 1974-75) 
Rev. 8/14V74 

1. 
2. 
3. 



KEY/SECTIO:: 



IF: 116. 18b 
IS: 3927 
3:2.2.1 . 



3:2.2.1 



AREA 1 .0 TOPIC , Comprehensive Progt 
•PI anning 

SOURCES 0/ INFORMATION- 
Program Director 6. Principal 

Business Manager 7. Resource Person 

Teacher 8. School Plan 

Aide 9. Planning Products 

Parent 10. Evaluator 



pnT\-T<? OF irrorT-iY 

SCHOOL LEVEL 



— r 



sou. 



1.3 Needs As sessment 

A needs assessment documen t is on 

file in the school and includes . 
the following data: I 

1.3-1 Base 1 te data on schoox popula- 
tion showing I 

(a) The number of students in > 
school [ 

(b) The ethnic and socio- 
economic makeup of student > 
population 1 

( c ) The number of students with 
English as a second Ian' 
guage I 

(d) The transiency rates of 

s t u4en t s I 

(e) The number of exceptional 
students, physically 
handicapped, mentally ^ 
handicapped, and gifted . j 

(f) The nature and effect of 
student background and 
factors such as cultural 
opportunities, travel^ 

and the communl t y environ- j 
m e n t . } 

(g) The student health data | 

1.3-2 Abilitv (or a chi e veaien t ) data 
of the student population. 

Including: . < . . . . I 

(a> D? c-^Rncstic data are a.ail- . 

ab 1 and s unwa r i zed . . j ^ 

( b ) Ach ] e vemen C*data are 

available and iiiclude | 
the following: I 

(1) Data from criterion- i 
referenced testing. ^ | 

/ 
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POINTS CF INPIIIRY 



SCHOOL LEVEL 



PR .127 (FY 1974-7C) 
aev. 8/14/74 

1 . 

3. 
4. 
5 . 



SOURCES 0 
Prcgrar. Director 
Business Manager 
Teacher 
Aide 
Parent 



INFORMATION' 
6. 
7. 
8. 
9. 

' 10. 



AREA 1 ^ Q TOPIC Comp rehens ive Progra4 
P 1 anni ng 



Principal 
Resource Per so i 
School Plan 
Pldnning Pro ducats 
Eva 1 ua tor 



8:Title 
117, 2 



II 



AVTHO? TTY 
KEY/SECTIOM 


POI^iTS 0? IN'OUIP.Y 
SCHOOL LEVEL 


C/5 

w o 


C/5 

w o 


w 

UJ o 
>^ z 


UJ O 


SOURCE 




1.3-7 (conr..) 

(2) Data from matrix 





1.3-3 



1.3-4 



1.3-5 



1.3-6 



1.3-7 

1.3-8 
1 . 3-9 

1. 3-10 



sampling or school 
ach ievement . . . . 

(3) Data from standard- 
ized achi evement 
tests administered. 

Summary tt^. ta on affective area 
of student development . » . 



Summary data on p sy ch omo tor 
area of student development 



Appraisal of the level of social 
and cultural understanding of 
students . , 

Appraisal of the degree to which 
the present instructional pro- 
gram provides d i agno s t ic / p re- 
scriptJve instruction for students 
on individualized basis 



Appraisal of health and socicl 
Sfrvicea RVai1a*^le to Ttxic'cnti 
both within and outsldo the 
school program 



Appraisal of staff needs „ . 

Appraisal of the nature and extent 
of parent involvement in program 
planning and implementation, along 
with parent education opportunities 

Appraisal of the need of library 
materials (printed and non-sprinted) 
to be obtained from Title II funds 
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POINTS OF INQUIRY 



SCHOf'L LEVEL 



PR 127 (FY 1974-75) 
Rev. 8/14/74 

1 

2 

3 
4 



SOURCES 
Program Director 
Business Manager 
Teacher 
Aide 
Paren t 



tXRLA l .n TOPIC Comnrehiens tve 

Planning 



FORMATION 

6 . Principal 



/ 



7, Resource^Person 

8, School Plan 

9, Planning Products 
1 0 , E va lua t o r 



AUrnORITY 

ki:y/sectio>: 



18:3928 



3:2,3.4 



3:2. 3m 



POINTS OF i:;quiry 

SCHOOL LEVEL 



V3 

W O 



V5 

u: C 



CO 



l: o 



1,4 
} .4-1 



1 . 4-? 



K4-3 



P rogram Goal Statements^ 

The school has preps^red program 
goal statements reflated to the 
following areas 



(a) Language ^development . , 

(b) Reading/ , 

(c) Mathematics y . . . . , 

(d) Multicultural 

(e) Staff development . , , , 

(f) Parent participation and 
community involvement . . 

(g) Parent education . . < 

(h) Healtli / auxiliary 
services 



U) Bilingual/Crosscultural 
(if required) 



The school hafi a list of eoal.^ 
with indications of priority 
level*. . . . V . 

The school has a list of program 
objectives correlated with 
school goals K ' . 



SOURCE 



1 
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POniTS 3F IMGIIIRY 



SCHOOL LEVEL 



IPR 1/7 (FY 1974-75J 
Rev. 8/14/74 

1. 
2. 
3. 
A. 
5. 



AREA 1 



AUTHORITY 
KEY/SECTION 



2:p. 3 
(Multicul- 
tural -Ed. ) 
IS: 3936 
3:2.5. 1 



(.Staff Dev. 
li' : 116. 17ra 
1S:3933 
3:2.5.7 
Jj_^ 3 



2:p. 3 
(Lang. Dev. 
1: 116. 17b 
IS : 3928 
3:2.5.1 



2:p. 2 
(Read ing) 
IF : 116. 17b 
IS : 3928 
3:2.5.1 



2:p. 3 

(Math) 

IF: 116. 17b 

IS : 3938 

3:2.5.1 



2: p, 3 . 
(Parent I n- 
vo Ivcnen t ) 
3:2.5.1 



(Health) 
3:1.2.1.7 
3:2.5.4 
2: p. 3 



IF: 116. 17b 
IS : 3928 

lF:117.^l7b 
IS : 3928 



SOURCES 0- iNFOrtMATION 

Program Director 6. 

BusinessManager 7. 

Teacher 8, 

AiJc 9. 

Parent 10. 



TOPIC Comprehensive Progra m 
Planning 



P r Inclpal 
Resource Person 
School Plan 
Planning Productj 
Eva lua t or 



POINTS OF INQUI.^Y 
SCHOOL LEVEL 







CO 




w. 




w 






o 


in 


o 


Ui 


c 


(4 


O 




5C 




72: 


>^ 









1 . 5 Pr ogram Components and Objectives 

The consolidated program includes 
ench of the requi r ed»- c omp onen t s 
a'J indicated in the table below: 



FUNDING 



COM'^ONENT 





SOURCE 


1 


2 


3 


4 


5 


6 


7 


8 


9 


(a; 


.itle I 


X 


X 


X 


X 


X 




X 


X 


(x) 


(b) 


SB 90'-EDY 


X 


X 


X 


X 


X 




% 


X 


(x) 


(c) 


ECE 


X 


X 


X 


X 


X 


X 


X 


X 


(x) 


(d) 


Miller- 
Unr uh 


X 



















\ 



Components : 

1. Reading 

2. Language Development 

3. Mathematics 

4. Staff Development 

5. Parent Participation and 
Community Involvement \ 

6. Parent Education ^ 

7. Health/Auxiliary Services'^, 
«. Mult^cultt^rfll FHucJirinn 

9. B ilingual/Cros scul tural 
(if requi red) 

(Title II has process activities only 
andnotcomponents.) 

1.5-1 Each component objective is re- 
lated to the needs assessment. . . . . 



1.5-2 Kach component description in- 
cludes specific performance 
(end product) objectives. . . 



SOURCE 
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POINTS OF INQUIRY 



SfHOCiL LEVEL 



PR 127 (FY 1974-75) 
Rev. 8/14/74 

1. 
2. 
3. 
4. 
5. 



SOURCES 
Program Directo r 
Business Manager 
Teacher 
Aide 
Parent 



INFORMATION' 
6. 
7. 
8. 
9. 
10. 



AREA 1. 0 TOPIC Comprehensive Progrj 
P lann ing 



P rinci pal 
Resource Person 
School Plan 
rUanning Products 
Eva lua tor 



AUTHORITY 
KEY/SECTION' 



POIKTS OF 


i>;qutry 




in 

w c 


CO 

w o 


'J o 


(/5 

u o 


SCHOOL 


LEVEL 








5^ SS 





SOURCE 



3:2.5.2 



lF:Sec. 6 
Civil 
Rights 
Act 

IS; 3935 



1.5-3 



1.6 
1.7 



1.8-1 



Each of the stated objectives is 
complete in content. Including 
the following; . . 

(a) That which Is to be known 
or done 

(b) By whom 

(c) Under what conditions. . 

(d) When _ 

(e) How achievement is to 

b e me a s u r e d . . . . . 

( f ) Mi nimum level to be 
achieved 

(Not applicable at school level) 

(Not applicable at school level) 



Isolation and Segregation 



The school does not sanction, 
perpetuate, or promote the 
segregation of students on the 
basis of race, ethnicity, re- 
ligion, sex, or socioeconomic 
status . . . . . . . . . . . 

(a) The program does not 
create special tracks 
for the educationally 
disadvantaged ^ > . . . 

(b) The program does not 
establish adjustment, 
pregrade, or Junior 
grade classes for the 
educationally dis- 
advantaged 
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S6 



poiriTS OF \mm 



SCMOfjL LEVEL 



PR" 127 (FY 1974-7S) 
Rev. 8/14/74 



A?.EA 



SOURCES 0- INFOKMATION 



TOPIC Comprehensive 
Plann ing 



Program 





1. 

2 . 
3. 
4. 
5. 


Program Dir ecto r 
Busi|Tiess Ma nager 
T e a h 0 r 
Aide 
P a ren t 


6. 
7. 
8. 
9. 
10. 


P r inc i pal 
Resource Person 
School Plan 
Planning Products 
E valuator 






AUTHORITY 
KEY/SECTION 


POINTS OF i:;QUiRY 
SCHOOL LEVEL 


CO 

'M O 

>* is 


u: c 
>^ :^ 


CO 

u o 
> 2: 


CO 

u o 
>^ ^ 


SOURCE 



1F:116.16.9 
a 

lS:a, 3942 
4: p.1 

lF:116.19a 
IS : 3943 



1.8-1 (cont.) 

(c) 



The school does not physi- 
cally Isolate children 
from their class mates on 
a scheduled daily basis, 
except in the foil ow ing 
instance: Based on the 
results of a comprehensive 
d lagnostlc assessment of 
student needs, children 
who are assigned to a reg- 
ular classroom teacher 
responsible for their in- 
structional program may be 
moved to a physical loca- 
tion other than the regu- 
lar classroom on a temporary 
basis until the diagnosed 
need has been alleviated. 
Such an alternate physical 
location includes, but is 
not limited to, a reading 
laboratory, a mathematics 
laboratory, a bilingual/ 
bicultural learning center, 
an intergroup education 
1 e r» rn In** coptp**, *\ H^o^riof!- 
tlc clinic, or similar facil- 
ities where the specific 
needs of the students are 
best served, v . . . . 



1 . 9 Nonpubllc/Nonprofit School 
Pa r t i c Ipa t Ion 

(Applicable to private school 
site revi ew) 

Renulred pro visions were made 
for the participation of stu- 
dents in NP/NPS 

1.9-1 Individuals knowledgeable of 
the assessed needs of NP/NPS 
child ren were involved tn the 
planning process 

1.9-2 Participating NP/NPS students 

live In or live reasonably coter- 
minous to the target area. . . . 
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POINTS OF INOIIIRY 



SCHOOL LEVEL 



PR 127 (FY 1974-75) 
Rev, 

1. 
2, 
3. 
4. 
5. 



SOURCES 0' 
Program Director 
Business Manager 
Teache r 
Aide 
Pa rent 



AREA 1 , 0 TOPIC comprehensive Program 
Plann ing 



I INFORMATION 

6, Principal 



7, 
8. 
9, 
10. 



Re source Person 
School Plan 
Planning Products 
Eva lua t or 



AUTHORITY 
KEY/SECTION 



POINTS OF INQUIRY 
SCHOOL LEVtl 




w o 



c 



SOURCE 



4 : p *2 



IF: 116. 19b 
IS: 3942 
4:p 1 



IF: 116. 19b 
IS: 3942 
4:p 1 



IF: 116. 19d 
4:p 1 



IF: lib. 19e 
4: p 2 



1^: llf . l'»c 



IF: 116. 19b 
IS: 3930c 



3:1.1 (6) 



KEW: Regula- 
t ions 



4:p 2 
5F: 117. 3e 



1.9-3 



1 . 9-4 

1.9-5 

1.9-6 
1.9-7 

1 . y-8 

1 ^ o _ o 
1.9-10 

1.9-11 

1.9-12 

1.9-13 
l.,9-14 



The criteria for selection of 
participants at NP^PS ar^e based 
on comparable EDY criteria used 
for selection of public school 
participants . . 



Activities are provided for 
eligible NiyNPS children which 
are comparable to those provided 
pub lie school participants. . . . 



Thfc special needs of eligible 
HPfjPS pupils were' considered in 
pllanning program activities. 



(jflot applicable at school level) 

; 

n'p^PS students receiving services 
it the public school site are not 
^^egregated from public school 
/participants. . . . . . . . . ^ . . 

Project staff serving at NPyNPS 
sites is under administrative 
control of the public school 
staff .:. ^ ...... . 

^Vccnnnrv c'' i t ^^r of 

project participants is assigned 
to the Niy^PS site only for the 
duration of t-he project. . . . . . 

Parents of participating NP/I^PS 
..nlldren and r'»presentat i ve 
^iWS'PS staff members are serving 
on the D is t r i c t. Advis o ry Committee, 

The NB^PS school receiving cate- 
gorical services has established 
a SAC. . . 

The NiyKPS has filed HEW Form 441 
(Civil Rights Act of 1964) with 
the USOE. ............... 

(Not applicable at school level) 

Materials acquired with funds 
made available by ESEA^Title II, 
Phase I, funds meet the needs of 
private school pupils and 
teachers 
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POI!!TS OF INQUIRY 



SCHOOL LEVEL 



PR 127 (FY 1974-75) 

1. 
2. 
3. 
A. 
5, 



AUTHORITY 
KEY/ SECT I ON 



\ 



SOURCES 0/ INFOAHAT^QN 
Program Director " ' 6. 

BuslnessManager .7. 
Teacher . 8. , 

Aide 9. 
Parent 10. 



AREA 1 , n TOPIC Comprehensl ve Program 

Planning 



Prjnctiv^l^ 
Resource Person 
School Plan 
Planning Products 
Eva luat o r 



poi>:ts of inquiry ^ 
school level 







CO 




CO 




M 






O 




O 


>< 




>i 


2 







SOURCE 



5F:117.3 



5F:117. 3 



5F: 117. 3 



4:p 2 
5F: 117. 3 



4:p 2 



1F:116.19 
4:p 1 



1.9-15 



1.9-16 



1.9-17 



1»9-18 



1.9-19 



1.9-20 



1.9 
1.9 



•21 
■22 



Materials purchased with Title 
II funds have been selected 
with the cooperation of appro- 
^priate private school personnel. 

Materials purchased with Title 
II funds are in compliance with 
the materials selection policy 
of local pub lie educational 
aj^enc ies 



Materials purchased with Title 
II funds and on loan to NP/^PS 
can be identified by the foil ow- 
ing: 

(a) Identification markings. , 

(b) Catalog listing 



(c) District identification 
markings 



Title II materials are to bene- 
fit private school children and 
teachers, nd are on a loan basis 
only 

NP^flPS has budgeted an amount for 
library resources (not Including 
Title II resources) this year 
equal to or greatet than previous 
fiscal years 



NP^PS officials were inc lude/ in 
the development of the following: 



(a) Needs Asses sment . . . 

(b) Goals ........ 



(c) Pupil Selection Criteria 
(Titlft I only) 

(d) Program Planning .... 

(e) Program Evaluation . . y 

Each NiyNPS has a program plan 

Each N5^PS has a functioning 
advisory committee 
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POIilTS OF lr:Q;iIflY 



SCHOffL LEVEL 



PR 127 (FY 1974-75) 
Rev. 8/14/74 

1. 
2. 
3. 
4. 
5. 



SOURCES 0. 
Program Director 
Business Manager 
Teachc r 
Aide 
Parent 



AREA, 

INFORMATION 
6, 
7, 
8, 
9, 
10, 



3. 0 TOPIC Parent and Community 
I nvo 1 vement 

Prihcipal 
Resotirce Person 
School Plan 
Plannitig Product s 
Evaluatsr 



AUTHORITY 
KEY/Si:CTIO>: 



POINTS OF 
SCHOOL 



INQUIRY 
L^VEL 



CO 










CO 




Ui 


o 




Ui 


c 




O 


>< 






>* 


S5 


>< 


:2 



SOURCE 



IF: 116. 17o 
15:3930.0 



IS: 3930.0 



lF:116.17o 
(l)i 



lF:116.17o 
(1)11 



IF: 116.1 7o 
(1) 



3:1.1 

3:2.1.4 

3 : Addendum 
3:2.1.1 



2.0 
3.0 



j(Not applicable at school level) 

PARENT AND COMMUNITY INVOLVEMENT 

The program provides for the re- 
quired parent and communi t y 
invol\einent as evidenced by the 
following criteria: . 



3.0- 
3.0- 



3.0-3 



3.0-4 



3.0-5 



3.0- 
3.0- 



(Not applicable at school level) 

There Is a functioning School 
Advisory Committee at each par- 
tlclpatlrigschool 



The application describes how 
parent *s we re Involved in planning 
the program 



The application outlines specific 
plans for continued involve me nt 
in develop roe nt, operation, and 
evaluation of the programs. . . 



/ 



The School Advisory Comml 1 1 ee is 
broadly representative of parents 
and the c ommun 1 1 y 



(Not applicable at schoo) level) 

Hach school has the following 
SAC products a va liable 



(a) Membership list (name, 

address, and phone number) 



(b) Composition 
(1) 



More than ^ simple ma- 
jority of participating 
members are parents (not 
employedby the school/ 
district) of participat- 
i ng chlldie»i 
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SIC 



PGIHTS ?F !::0!i!RY 



SCHOf.L LEVEL 



127 (FY 1974-75) 

V. Zllikllik 

1. 
2 . 

5. 



SOURCES 
Program Director 
Business Manager 
Teacher • 
Aide 
^Paren t 



0/ 



INFOKMATION 
6. 
7. 
8. 
9. 
10. 



AREA 3 , 0 TOPIC p^r^n^ rotyrtminity 
Involvemen t 



Principal 
Resource Person' 
School Plan 
Planning Products 
Evaluat or 



AUTHORITY 
KEY/S^CTIO^^ 



POIKTS OF INQUIRY 
SCHOOL LEVEL 



10 








CO 




10 




U3 


0 








0 


u 


0 


>* 




>* 


:^ 


5- 




>* 





SOURCE 



3:2.1.1 



3:2.1.1 



3:2.1.1 



3.0-7 (cont . ) 

(b) Composition (cont.) 

(2) Reflects ethnic and 
^ socio-ec-onomic compos i- 

tion within the com- 
munity 



3:2.1.4 



3:2.1.4 



3:2.1.4 



3: 2.1.4 



(3) Includes parents of stu- 
dents in all age spans. 



(4) Includes levels funded 
by ECE 

(3) Includes classified 

aides, teachers, assist- 
ants, or other support 
pe r Sonne 1 



(6) 



Includes teachers and 
administrators (mu^ t 
include representation 
from the ECE funded 



(c) A ledger recording changes 
in membership . . . . v . 



(f) 



(g) 



(1.) 



A sc^e'^ule and content ^ 
descriptlpn of SAC trailing 
ac t i V i t i es . . . . . . . 



A schedule of dates and lo- 
cations of SAC meetings . . 

A description of communica-- 
tion channels used to pro- 
vide information to the SAC 

A description of communica- 
tion channels used by the\ 
SAC for bringing recomment 
dations into the decisionA 
making process 



A record of the m^^Jority 
recommendat 1 ons made or en- 
dorsed by the Committee in 
each step of the planning 
process . . v 
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POiriTS Of INOIJIRY 



SCHOf.L LEVEL 



PR 127 (FY 1974-7S) 
Rev, S/IU/7U 

1, 
2, 
3, 
4, 

"5. 



AREA 3.0 



SOURCES 0 
Program Director 
Business Manager 
Teache r 
Aide 

.Parent ^ 



iNFOKffATION 
6, 
^ 7. 
• 8, 
9, 
10, 



/ 



TOPIC Parent and Comrounity 
Iitvo 1 veme n t 



Principal 
Resource Person 
School Plan 
Planning Products 
Eva luat o r 



AUTHOniTY 
KrY/SECTIOK 



POINTS OF INQUIRY 
SCHOOL LEVEL 







CO 








ui 


o 


u 


o 


u 


o 


>* 




>> 




>• 





o 



SOURCt 



IF: 116, 17o 
(2) ii 



IF: 116. 17o 

(2) V 
3:l,1.3.4j| 



IF: 116. 17o 
(2) ii 
(2> iii 
(.2) vil 
IS: 3930a 
4 : Addend um 



lF:116.17o 



3.0-8 Each member of SAC has been fur- 
nished with federal regulations, 
guidelines* state regulations, 
current^and past project appli- 
cations, ^valuation reports, and 
other information needed in plan- 
ning, developing^and operating 
the pro j ec t . 

3.0-9 The program includes specific 
provisions for informing and 
counseling with parents concern^- 
ing services to be provided their 
children ' , 

3.0-10 SAC was involved in making recom- 
mendations about the following: 

(a) Needs assessment i_ 

(b) Goals and objectives ^ 

(c) Evaluation . . • . . » . , • , . i 

(d) Staff development 

(e) Parent participation ..... . [_ 

(f) Parent education 

(g) Application for funds I 

(h) Identification of commu-. i 
n i t y res c>,u r c e s > . . l_ 

3.0-11 The school ha<? adequate procedures 
to insure prompt r&sfonse to com- 
plaints and suggestions from parents 
and advisory groups (Al27-S,Page 2) ... 
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POniTS OF IMOniRY 



^^CHOuL LEVEL 

^ — ^ — 



|PR 127 (FY 1974-75) 
Rev. B/li^/l^i 



3.0 

AktA 4 . 0 



3. 
5. 



SOURCES 0 
Program Director 
Bus iness Manager 
Teacher 
Aiac 
Parent 



INFOKMATION 
6. 
7. 
8. 
9. 
10. 



farent and Com. Involve* 
TOP rC Dissemination of 
I n forma t ion 



Principal 
Jlesource Person 
School Plan 
Plant! ing Products* 
E valuator 



AUTHORITY 
KEY/SECTION^ 



POINTS' OF INQUIRY 
SCHOOL LEVEL 







</> 








u 


o 




c 


u 


O 






>• 






2: 



u o 



SOURCE 



3;2. 1.3 
4:p 2 



3 : Addendum 



1F:116.17 



i : 2 . 6 . 4 



lF;116.25a 



lF;116.25a 



8H17.10 



3.0-12 



4.0 



4.0-1 



4.0-2 



4.0-3 



4.0-4 



Assurances have been signed by 
SAC chairman that the committees 
have been Involved all phases 
of the program and will be in- 
cluded in all the phases of pro- 
gram Imp lemen ta 1 1 on 



3.0-13 



Title II materials are available 
to children and teachers in public 
and private schools on an equit- 
ablebasis . . . . 



Title II materials are le-idily 
available to teachers and 
students . . . . 



If the school has established 
additional committees, an assur- 
ance has been signed by the 

cha i rman ofeachcommitteestat- . 
ing that the committee has: | 

(a) participated fully in the . 
pi an ning process { 

(b) brought its recoramenda- 

tions to the school advisory . 
committee [ 

DISSEMINATION OF INFORMATION 

Intormation is being disseminated / 
asrequired. . . . . 

The schoo-1 is following its ap- 
proved plan for dissemination of 
information to parents ^and com- 
. munity . , ..>,.>........ j 

The district is following an ap- 
, proved plan for the dissemination 
to teachers and administrators of 
the significant developments and | 
experiments in education. . . . . 
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POIHTS DF IMOiilRY 



SCHOfL LEVEL 



?R 127 (FY 1974-75) 
Rev. a/U/7'> 

1. 

2. 
3. 



AREA 5.0 TOPIC Hvaluation 



SOURCES 0/ 
Program^ director 
Business Manager 
Teacher 
Aid2 



5. Parent 



INFOKMATION 
6. 

7. 
8. 
9. 
10. 



Principal 
Resource Person 
School Plan 
Planning Products 
Evaluator ] 



AUTHORITY 
KEY/SrCTION 



POINTS OF INQUIRY 
SCHOOL LEVEL, 



to 




to 




to ^ 




CO 






o 




c 




o 


Ui 


o 






>• 




>• 




>- 





IF: 116.22 
a,b,c 



IS; 3929 



3:2.5.3 



1S:3929 



3:2.3.3 



1F:116.22 
1S:3929 



9:p 11 



1F:116.23 



5.0 
5.U-1 



5. 0-2 



EVALUATION 



The school has on Tile an evalu- 
ation design which Includes tho 
fol loving : ^. 



(a) 



(b) 



(c) 



(d) 



Clear ly stated, measurable 
performance, (end product) 
ob 4 e c t i ves 



Clearly defined activities 
for meeting performance 
ob j e c t i ves 



Instruments for pre^/post- 
testing including behav- 
ioral change assessment 

Analysis design to show to 
what degree the p r^ g rp m 
objectives were acnieved v 



(c) Dissemination plan 



The planned evaluation program 
is being Implemented as 
evidenced by;' 



(a) The evaluation activities 
recorded and up-to-date 

(b) Base line (pre-test) data 
collected » recorded, and 
anal y zed 



(c) Process evaluation data 
(activities) collected, 
«, 'Xecorded, and^analyzed . . 

((d) it^t year's evaluation 
\^ i ripo^rt findings dissemi- 
jpa ted in understandable 
language to staff, parents,' 
and community 



(e) Current program process 
evaluation disseminated 
to s taf f 
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PGIMTS OF IMGIJIRY 



SCHOOL LPVEL 



R 127 (FY 1974-7S) 
ev- 8/14/74 

1-, 
2. 
3. 
4. 
5. 



6.0 Fiscal and Administration 
AREA 7 . 0 TOPIC Management Plan 



SOURCES 0 INFORMATION^ 



Program Director 

Business Manager 

Teacher 

Aide 

Parent 



6. 
7. 
8. 
9, 
10. 



Pr incipal 
Resource Person 
School Plan 
Planning Products 
Evalua tor 



AUTHORITY 
vEY/SrXTION 



poi:;ts or imqutaY 

SCHOOL LEVEL 



U3 




cn 




OQ 




V5 




Ui 


o 




c 


'il 


o 


W 


O 


>* 




>* 


z. 


>* 




>* 





SOUIl.CE 



lF:116.17h 
116.20 
lOOb. 210 

f 212 

\ 

Title V: 
3940, CEC 
IS CEC:6445 
16,19 ECI 



1F:117.12 
8:Title II 



3:2.6 



6.0 FISCAL AND ADMINISTRATION 

(6.0-1 through 6.0-6 not applicable 
at school level) 

6.0-7 Fquipment and other capital out- 
lay items purchase.', with consoli- 
dated application program funds 
meet the following requirements: . . , 

(a) The item is necessary in 

terms of implement ing the , 
consolidated program.' ■/ 

(b) Title I equipment has be en 

labeled with the foil owing , 
information: * l_ 

(1) ESEA, Title I . . . [ 

(2) Month and year of 
purchase (only if 
purchased after 

June, 1972) .... t 

(c) Each item purchased with 
Title II funds is stamped 

identified as property of 

the district . . , ^ 

7.0 MANAGEMENT ,,PLAN 

The school is implementing its 
management plan which includes 
the following: 

7.0-1 Tasks listed to support or facili- 
tate school-level operations ^ 

7.0-2 Task responsibility assigned ....... 

7.0-3 Implementation time lines 

7.0-4 Program review and«problem 

solving procedures . . . . 

7.0-5 fe*eporting procedures listed 

anddescribed 
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POIiiTS INQUIRY 



SCHOriL LEVEL 
J* — 



PR 127 (FY 19" 
Rev. 8/1A/7A 



4-75) 



AREA 8.0 TOPIC Program Design 



SOURCE^S 0. 
Program Director 
Business Manager 
Teache r 
A i c 
Parent 



INFOHMATION 

7-: 

• 8. 

9. 
10. 



Principal 
ilasource. Person 
School Plan 
Plar.nin^ Products 
H valuator 



AUTHORIT 
KZY/SECTI 



ON' 



3!2. 5. 11 



POIN'TS OF INQUIRY 
SCHOOL LEVEL 



00 






CO 




w1 






c 


u: o 








o 


>- 




>* 


>« 




>* 





8.0 



8.0-1 



8.0-2 



;.0-3 



9.0 



PRO 



DESIGN 



The school planning products 
developed in the designing of 
the program include : . . . . 



A description of the categories 
of criterion-referenced objec- 
tives developed at the school 
level ctLu d descriptlou of Lite ^ 
vay in which they are cataloged 
at the school level 

A summary of the program colHp o- 
nents of the school's comprehen- 
sive program plan 



A resource utilization pi an 
which includes: . . . . . 



(a) 



vb) 



A record of the amounts of 
each catej^orical rcs.iurce 
(all resources for LCE 
schools) . . . . , , . . 



M 1 c :i va r I o as 
r-.' ce i ve 



T I: e extent to 
subpopulat ions 

c o r \F i c < fr'>n> \ -r* t\\ \7 \ A x\ A 

categorical refourcos 



SOHRCl 



(Not Applicable at .Sciiool Level) 
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POINTS 3F vmim 



SCHOf L LEVEL 



'R 127^ (FY 1974-75) 
lev. '8/14/74 



SOURCES 0 •• INFORMATION 



cultural 





1 . 

2. 
3* 
' 4. 
5. 


Program Director 
Business Manage r 
Teacher 
Aide ? 
Parent 






6, 
7 . 
8, 
9 . 
10. 


Principal 
Resource Person 
School Plan 
Planning Products* 
Evaluator 






AUTHORITY 
KEY/SECTIO>: 




POINTS OF 

SCHOOL he 


QUi:iY 
VEL 






CO 

u o 
a: 


UJ o 


c 

2 


o 


SOURCE 



10:AB2284 
IS: 3927 



10.0 
10.0-1 



BILlNGUAL/^RC^i^LTUKAL 



The followxng products have been 
developed by the participating 
school:" 



( 



i) The school has on file 
torms provided by the 
Department of Education 
vh i c h proviae the fol- 
lowing information/ . , 

(I) Identified goals for 

M lingual education as 
determined by the local 
need assessment . . 



(2) Ac ti VI ties designed 
piovido the follow- 
i n g : , 



to 



-develop competence 
in two languages for 
all participating 
p up i Is 

-positive reinforce- 
nen t o*^ t^e seH 
ir:iige of participat- 
ing children 

- (i e V e 1 o p r. c n t of i n 1 r - 
»;r(>iip .ind intercultural 
au*ireness among pupils, 
parents, and the staff 
i,n participating school 
districts 

(b) The identification ^ objec- 
tives for the attai n'ne n t of 
these goals (the objectives 
to be stated in neasurable 
t f rms ) . . . ... 

^c) A description of how t^p 
student is tb demonstrate 
the knowledge ^ ^ skill to 
b e ai n i e ved . . . . . . 
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ponrrs of imcuiry 



SCHOfiL LEVEL 



PR 127 (FY 1974-75) 
Rev. 8/14/74 

1. 

2. 
3, 
4, 
5. 



SOURCES 0 
Program Direc Cor 
Business Manager 
Teache r 
Aide 
Paren t 



iNFORMATIOri 
6. 
7, 
8.' 
9 . 
10. 



AHEA iCO topic BiUngual/Cross. 

tu 1 1 u r al 



Principal 
Resource Person 
School Plan 
Planning Products 
Eva luato r 



AUTHORITY 

KEV/srcTic>: 



POINTS OF INQUIRY 
SCHOOL LEVEL 



















w 


o 


U 


o 




c 




o 






>^ 








>* 





SPURCl 



The school is implement- 
ing a manage me nt pi an to 
organize, coordinate, and 
monitor with distinctly 
outlined plans that will 
ensure success in the 
bilingual program 



(e) 



The school is implement- 
ing a plan for teacner and 
aide pre-service training 
which will identify and 
improve knowledge 1 eve Is 
o£ each teacher and aide 
in teaching metho'dology, 
bilingual philosophy, and 
education 



10.0-2 



(b) Enrollments which not 
more than two-thirds of 
the children are limited- 
Dnejlifaii-at/eaKing ctilidren 



(f) The schooJ. is implement- 
ing an inservice training 
program for teachers and 
aides that is linked with 
an institution of higher 
education, which shall 
include the establishment 
of a liaison with a nearby 
, institution in order to 
rontiniinllv uocrade the 
bilingual educational pro- 
gram., . , . 

(g) A parent-tencher communi- | 
cations plan . . . . . . 

Class Composition Requirements 

Bilingual classes have:- 

(a) An approximate balance 
between the number of 
children whose primary 
language is other than 
Englishand children 
proficient in English . 




34S 



S18 



PCniTS OF INQUIRY 



I 

.SCHODL LEVEL | 



PR 127 (FY 1974-75) 
Rev, 8/14/74 

1. 
2. 
3. 
4. 
5. 



SOURCES 0/ INFORMATION^ 

Program Director 6. 

Business Manager 7. 

Teacher 8. 

Aide 9. 

Parent * 10. 



A*REA iQ,Q TOPIC Bilingual/Cross- 
Cultural 



Principal 
Re source Pe r son 
School Plan 
Planning Products 
Ev a lua t or 



AUTHORITY 
KEY /SECTION 



poixTs or ixQumv 

SCHOOL LEVEL 



Ui o 



w o 



Ui O 



Ui 



SOURCE 



IS : 3936 



10.0-3 



IS : 3929 



10.0-4 



IS : 3930 



10.0-5 



Instruction 

The participating school has an 
articulated sequential program 
of instruction in bilingual edu- 
cation designed to develop com- 
petence in English and in the 
primary language of the limited- 
English- spe aking participants. . 



Evalua t ion 



(a) The school has evaluated 
each child to be placed 
in a bilingual program. 
His strengths and weak- 
nesses in English and in 
the second language of 
instruction have been as- 
sessed 



(b) 



The school has established 
a plan for the evaluation 
of the children's i^rogress, 
including, buX limited to, 
reading comprehension and 
speaking skills in English 
and the seconc* lanrua^e of 
instruction "\ . . , 



School Advisory Committee 
Participation 

A parent advisory group in which 
parents of participating students 
shall constitute a simple majority 
has been established, or desig- 
nated from an existing parent 
group, at each school having a 
bilingual program. .: .: . . . . . 



er|c 



S19 



347 



TABLE OF CONTENTS 
PR-127 SCHOOL LEVEL 
QUALITY REVIEW 



TOPICS 

RST-PRI-ECE Quality Rating Scale . . . 
Points of Inquiry - Program* Quality 
Criteria to. Be Aaaeaaed ..........i> 



■'^48 



QUitLirr REVIEW APPROACH 

\/ Iteaa Included as "Points of Inquiry - Prograa Quality" are baaed on 
regulations and policies » and the determination of progran quality la nandated. 
Each of the items listed on the "Points of Inquiry - PrograxT Quality" is to be 
rated on the 0-9 Quality Rating Scale vhich has been cooperatlTely doTeloped 

the Regional Service Teams^ the Program ReTiev and finprovement Ihilt, and the 
Early Childhood Education Mtnagement Team. 

After careful on-site reriev and personal observation of the program^ the 
reriewers vlll determine the rating to be ^iven each line item on the form on 
pages Q3 and^Q^. Each rating will be determined in relation to the accompanying 
criteria listed under the heading, "Criteria to Be Assessed." 

It is reconnended that the local school coaplete the quality section 
prior to visitation by the reviev team for comparison vlth the team findings. 

These criteria are not intanded to be all-inclusive » but do represent a 
foundation upon vhich an educational program of high quality can be built. 
For exanq>le» the reader might note criterion under Individualized Instruction, 
"Classroom grouping is done according to needs and interests, not ability." 
If an observation of the classroom gives evidence of grouping by ability, this 
criterion would not be met, and the need for .improvement in individualizing 
procedures would, therefore, be indicated. 

It should be understood that no specific school is expe.cted to meet all 
of these criteria in order to have an^ effective program. However, it is 
poasible that at some futxire time a niimber of schools may achieve this 
exemplary status. 



Needa 

improrewmnt 



RST-FRI-ECE QlIALm WSjm SCALE^ 



0 s No eTidencei or none of the 

criteria are being net* 

1 = A Tery limited uae of the 
criteria is being aade and irith 
very liaited effectiveneae* 

= A liaited use of the critaria 
ia being «Bulei and with limited 
effectiTeneaa. 



Shows 
proffiiae 



Satisfactory 



High 
quality 



- A limited uae of the criteria 
ia being madei and with moderate 
effectiveneaa. 

^ ~ Most of the criteria are being met, 
and with moderate effectiTenesa* 

2 Host of the criteria aure being met 
effectively, at a level which can 
be described as good« 

6 The criteria are being met 
effectively, at a level lAich can 
be described as very good* 

7 = The criteria are being met 
effectively, at a level which can 
be described as excellent* 

= The criteria are being met 
effectively, at a level which can 
be described as superior* 



9 = The criteria are being met 

effectively, in a manner i^ich 
could qualify for recomiendation 
statewide* 



^Please see suggested criteria, lAiich have been developed from 
k sources: a) intent of state and federal laws, regulations, 
and policies; b) Program Implementation Recommendations for 
Early Caiildhood Education by a statewide committee of 1^ parents 
and professionals in 1972; c) results of the pilot Honitor and 
Review Program in spring, 197^; and d) national quality criteria 
for Right to Read Programs by U.S*0*£*, Department of Health, 
Education, and Welfare* 
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poiwrs or i 



^ PROGRAM QUALIIY 



DB;M3tMi4ild 
RBTiicd e/14/74 



dtral Radiations 3» tarly Childhood Eduoation Polioies 5* Instructions for ConoprehensiTe 

lifond& Education Code 4, California Atainistration Code (Title 5) Program Planning 



eotioft 



(t) 
(g) 
(e) 

(•) (b) 



137 



3 (c) 



ON-SITO ARK^S or INGUIFY 



!• IMDIVIiXJAUZCD INSTHJCTION 

A. Qy'ganl^zation * The classroom instructional program is organised 
to proride for oontinaous student progress int 

readings , 



language deTel9psent*_ 
mathematios* 



B. Diagncsis * Continuous use of data from diagnostic tests 
and s/stenatio obserration of indiridual student progress 
is made in: 

reading* 



language deTelopDent*_ 
mathfloatios* 



C» Coatinmous Progress , A oontiouum of instructional obJeotiTes 
sezres as the basis for indicating student progress frou 
oritericn^referenoed measures in: 

reading * 



language deTelo|Mnt«^ 
ma tbsM t ic s • 



D» Prescription * Various prtsoriptire tasks , materials , and 
methods are arailable which are specific to the diagnosed 
needs of each student int 

read ing* 



language develoiiDent*^ 
mathematics* 



0 



£• Doouaentatlon » Pupil progress is charted or documented in: 

reading* 



language derelcpment*^ 
ma t hcDia t i os • 



f • Balance < 



Progrsn proTides a balanced ourricultra* 
optional oomponent (list)* 



optional component (list)«_ 



II* LCARNiHG miRomzxrs 

A* Program enhances derelcpoent of positire self-KM>noept* 



B» There is eridence of student interest and motlTatibn. 



C* There is eridenoe of effort tomrd OGoiprehensiTe restructuring 
of the learning enrirowMnt to meet the unique needs » talents, 
interests 9 and abilities of each student* ... 



HI. miaicousaRjkL 

Progrw regularly includes actiTities idiich pmote sieenligful 

interenltuml understanding among children from different racial, 
oultuml, and socioeconomic baolcgrounds « 



K-3 



|-n^/^" timolttdes bilingual component irtxen an appreo59ible number of non-Dbg^^l^U^^^ 
Cly V okildren are serred* 



<i3 



ON-sZ'n^ AREAS OT nccuiror 



lC-3 



Indlo&ie 
Other 



(o, ii, 
▼J) 

'1 (a) 

(i) 



(k) 



W (Art. 
3.3) 
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IV HEAI/r^/AUXIUAW SIKVICIIS 

A* Health serrioes - pfcQTtioal^ TifUAl» suditoiy, dental, apooohi 
psyobologioal - meet the needs of iadirldnal stodentt 

thrm^ : aoraeniBj/referra l 



f ollow^ D 

B« Ouidanoe eerriees meet the needs of ladlTidual students 
thrau^ X aoraening/refcrra l 



follon^p^ 



C. Bilintaal Counselors/Psychologists fluent in the language 
of students are ara liable « 



D, Health screening data are utilised tjy tke teachers > 

£• There is eridenoe of a comimhensiTe health education prognffi« 



V. FAmn PARTICIPATION 



A. The School Adrisozy Conmittee meets regularly and 
effectirely represents t>Arent8'and the ocnnRinity*^ 



B* Parents are regularly iarolTed ins 

program planning 



assistance in classroom,. 



other suppoi^iTe assistance^ 
program cnrmluatio n 



Cm There ia an aotire program to arouse parent interest and enlist 
support - - , — 



D. The program encourages home-school coocnmioation in easily 
understood language » 



VI, PAREKT EDUCATION 

A, Parents participated in designing a parent education program 
nhich reflects their needs and interests. 



B« Parents are participating in the parent education program,^ 



VII. STAFF DEVELOPMENT 

A* Inservloe program meets assessed needs of: 

t each era 



paid aides^ 
Toluateers. 



adoaiais trator ( s )^ 



B« The selection axid asaigment of staff facilitate implementa- 
tion of the program. 



C# Staff haa been inrolTed in deaigjaing the staff derelopment 

program • - _ - _- 



VIII, ARTICULATIOH AND COORDINAtlON 

A* There is eridenoe of articulation with the preschool lerel 
and child care programs in the oonmunity tWCl)m 



B« Progrma prorides for articulation of all programs within 
the aahoQl^ 



C# Ccmmmity resources and parent talents are effectirely. 
utilia^d. 



* CRITERIA TO BE ASSESSED 



REyiEWER'S WOTTES 



I. IHDIVIDIIALIZED INSTRDCTION 

A* ClMsroom Infitructionml Program 

Variations of cognitive! affective, 
peychomotor growth are accooaiodated 
in clasarooB organisational plan* 

Tasks and areas of responsibility for 
each staff member (including Tolxinteers 
and student tutors) are described* 
understood f and assigned* 

Record keeping has been systematized so 
that it is a manageable task* 

Records are up to date axid utilized* 



Adequate time ia provided for record 
keeping* 

Adequate time has been scheduled by the 
teacher for planning with aides t Tolun* 
teers« and/or cross-age tutors* 

Provision has been made for large group, 
small groupt and individual instruction* 

Classroom grouping is done according to 
fiieeds and interests, not ability* 

Classroom grouping is flexible, accom- 
modating the unique needs, talents, and 
interests of each student* 

Feedback is used from parents and students 
about classroom organization and management* 



B* Diagnostic Data 



Individual students are involved in a con- 
tinuous program of diagnostic assessment* 

The initial diagnostic prescription is 
modified regularly as observations are made 
of the student^s behavior, attitudes, and 
school wozic* 



Diagnostic information is srecorded so that it 
can be communicated to staff, parents, and 
students* 

^e criteria were developed from four sources: a) intent of state and federal lavs, 
itions, and policies; b) Program Implementation Recommendations for Early Child - 
Education by a statewide committee of 130 parents and professionals in 1972; 
)0ult6 of the pilot Monitor and Review Ftogram in spring, 197^; and d) national 
Lity criteria for Right to Read programs by USOE, HEW. 
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Diagnostic Data (continued) 



Students have opportunities for self- / 
assessment t self-evaluation , and pers/nal 
decision making* 

Contiiraotts Progress 

Each student is appropriately placed in 
a sequence of instructional objectives 
with related criterion- referenced 
measures* 

The interests and needs of each student 
are considered when learning tasks are 
assigned* 

The manner in which each student learns 
.best is assessed and accommodated. 

Continuous assessment of each student's 
progress is made and learning tasks are 
modified accordingly. 

Prttscriptive Tasks, Materials « and Methods 

""here is a variety of materials, methods, 
and tasks wide enough to provide for the 
diverse abilities and learning rates of 
the students. , 

The ethnic and cultural diversity among 
the students has been considered in the 
selection of materia].s. 

Learning centers which are directly 
related to objectives identified for 
the students are organized and used 
in the classroom as an integral part 
of the learning process. 

Alternative ins true tionaO. tasks are 
available to students until mastery of 
each specific skill is attained. 



Pupil Progress Documentation 

The personCs) responsible for developing 
and maintaining individual student 
records has been designated. 



Records are readily available to the 
staff. 
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REVIEWER'S NOTES 



Pupil Progress Documentation (continued) 

The teacher regularly reviews the recorcjed 
data for each student and makes the 
necessary prescriptive adjustments* 

The record keeping system yields luider- 
standable information to the teacher 
that can result in the assignment /Of 
appropriate learning tasks* 

Balanced Curriculum 

There is a balanced curriculum, includ- 
ing music,, art, social studies, science, 
health education, physical educaition, 
and movement exploration* 

II* L?2ARNING ENVIRONMiWT 

A. Positive Self-Concept 

There are opportunities for students to 
develop feelings of self-worth and 
well-being* 

There are opportunities for students 
to develop attitudes of self-discipline, 
self-control, and independence* 

Each learner can observe a record of 
his successful completion of each 
assigned task* 

^The program provides for positive 
reinfoTTpment of tjoica learner's success* 

The program makes i.ix>vision for each 
student to make progr s in the ability 
to deal with his own jl ings* 

The prograun makes provision for each 
student to make progress in the ability 
to deal with the feelings of others* 

t 

The program provides opportunities for 
students to develop a sense of trust 
in peers and cuiulte* 

The program provides opportunities for 
students to develop a feeling 4f respect 
for adults from the whole community* V 
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student Interest and Motivation 

The classroom is an ai^^ractive learn- 
ing environment for students^ 

The learning environment reflects the 
talents and interests of students. 

Learning tasks are designed to be 
sufficiently challenging to extend each 
student* 

Students are given opportunities to 
wox^ and plan together* 

Students willingly assume responsibilities 
for classroom chores* 

The program provides a balance between 
leadership and- followership roles for 
students* 

Comprehensive Restructuring 

The program provides a variety of 
opportunities for students and teachers 
to develop and exercise creativity* 

The program encourages the development 

of logical thinking and reasoning ability* 

The program provides immediate alterna- 
tive , for students if initial attempts 
are unsuccessful or unproductiver. 

There is a record of the choices of the 
alternative tasks used by the learner 
to accomplish the skill(s) assigned* 

There are records of planning techniques 
used by staff to show how the learner 
was involved in the alternatives used to 
accomplish the tasks* 

A continuum is provided to record success- 
ful completion of the assigned tasks* 

There is evidence that the school has been 
making whatever changes have been deemed 
necessary to accomplish the desired 
restructuring* 




:il, MULTICULTURAL 

Activities include ethnic studies, such as the 
history and contributions of minoritieSi and 
desegregation/integration efforts. 

The program provides for :^bservation of vari- 
ous cultural affairs ^d celebrations. 

{ 

, Opportunity for multicultural experience is 
- ^provided through activities, such as sports 
and other after- school events. 

The iJrogram participants and comraunily effec- 
tively ptoticipate in multicultural activities, 
such as the Sister City program, or various 
recreational programs. 

There is evidence that multicultural instruc- 
tion 16 regularly being incorporated into subject 
. aatter other than the social sciences* 



IV. HEAXTH/AUXILIARy SERVICES 

A, Referral atnd Follow-Up 

Provision is made to include health 
consultants and school nurses in 
developing and keeping health policies 
current* 

Health screening is completed earl^/' 
enough in the school year so that each 
student's needs cam be corrected or 
acconmiodated in time to maximize his 
participation in the program. 

Parents have been notified of visual, 
auditory, dent^, and other physical 
deficiencies discovered in the health 
assessment. 

Communication regarding health defi- 
ciencies of the student is made in \ 
the home language. 

* * A comprehensive survey of community 

health resources has been made in order 
to match the available resources with 
the identified student needs. 

When parents need assistance in obtaining 
necessary treatment for their children, 
the school provides he^^p for them in 
securing the needed services. 
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E« Coapv^eheiusiTe Health Instruction 

The program la designed to assure 
the optiiBua physical « emotional « ai.d 
mental deTelopaent of every student. 



REVIEWER^S 

A* Reff^rral and Follow^Up (continued) 

Nutritional deficiencies have been 
assessed and supplementary food is 
available to the students if needed* 

Health deficiencies discovered by 
assessnent are followed up and a 
record is kept current. 

B* Guidance/Psychological Services 

A team approach is used to aieet guid- 
ance and counseling needs t coabining 
the skills of guidance workers, school 
psychologists t psychoMtristSt nurses « 
teachers, other school staff « and parents* 

Students yibo exhibit observable needs 
^\ for counseling and guidance are re* 
' ceiving the services related direcily 
to the identified needs* 

If students need guidance services not 
available within the school/district « 
the school makes information about 
community services available to the 
parents • 

Identified guidemce needs are followed 
up and a record is kept current • 

Personnel involved in guidance « coun- 
sel ing, or psychological servicr are 
used at the level for %diich they are 
trained • 

C* Bilingual/Guidance Services 

Guidance services are available to 
students in their hone language • 

D. Utilization of Health Data 

A health history for each student,' 
including vision, hearingt and 
results of recent medical evaluation, 
i% utilized by the teacher to deter- 

niise appropriate instruction* ^ 
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REVIKOSR^S NOTES 



fi. Coapr«hrafiive Haidth Instruction (continued) 

The nutrition education prpgrui pHaces 
■ajor eaphasie on the relationship 
between food, health, and growth. 

The health education program for Btvdents 
includes inforaation and sotivation for 
assuaing pertenal responsibility for the 
derelopMnt of sound health practices, 
including accident prerention, euTiron* 
Mental sanitation, and first aid. 

The program provides health educa- 
tion through inservice woricshops for 
teachers I school administrators, school 
nutrition personnel, school nurses, and 
other staff meab^rs. 

The program provides parent classes in 
consiuner problems, health education, 
and nutrition information. 



V. PARENT PARTICIPATION 

A. Advisory Committees 

Parents regularly participate in the 
School Advisory Committee. 

Paren^ts. participate in the decision- 
making process through the assessment 
of educationaOL needs, definition of 
goals, planning of the program, and 
evaluation of the effectiveness of the 
program. 

B. Parent Involvement 

Parents are welcome at school* 

The staff provides for continuous 
parent involvement in the ^initial 
planning of the program and in its 
implementation, evaluation, and 
modification. 

Parents regularly participate in class- 
room activities. 

Parents regularly participate in other 
instructional activities outside the 
classroom* 
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B* Parent Involvement (continued) 



Representatives of the community other 
than parents are involved in the opera- 
tion of the program^ 

Parents share in determining the direc- 
tion and content of their children's 
schooling. 

Opportunities are provided for parents 
to be directly involved in the formal 
education of their children in both 
the classroom and the decision-making 
process* 

Parents know about the various school 
programs. 

This information is written in language 
easily understood and in the language (s) 
reflecting the ethnic makeup of the 
school community. 

Aides and volunteers are recruited from 
and are representative of the school 
community. 

The program facilitates communication 
among ^he school staff , parents, and 
the community. 

Parents are encouraged to inform and 
advise the school staff regarding 
community conditions, customs, aspi- 
rations, and gofiuLs. 

Barents are involved in budgetary 
determinations. 

Child care at the school site is 
provided if needed. 



aiRENT BDDCATION 

A. Design of Program 

Parent education la baaed on the needs 
and interests indicated by parents. 

Registration for parent education 
activities is free of charge or 
requires only a aaall fee« 



3t0 



SEVISVER^S MOTBS 



A* Design of Program (continued) 

Child care at the school site 
ilMiPpTided, if needed* 

The parent education program is 
evaluated by parents. 

B# Operation of Program 

Parent education programs are 
offered at the local school site, 
or at some other location convenient 
for parents. 

Prograjne are scheduled at times th'at 
are convenient for parents. 

Various topics, such as child growth 
and development, nutrition, information 
on school programs, and inter-family rela- 
tionships, are offered. 

Classes are offered on arts, crafts, ^ 
hobbies, cooking, etc. 

Studies are available which can 

help parents obtain a diploma, degree, 

license, certificate, etc. 

Course work is provided which would 
qualify parents for jobs they may want 
to hold. 



II • STAFF DEVELORffiNT 

A. Assessed Ncr^cV? oi Staff ("Staff*' is defined 



as all people who participate in the school pro- 
gram, including principal, teachers, paid 
aides, volunteers, and others.) 

The inservice program has evolved out 



volving totfti staff, all levels; 
parents; ethnic representation; and 
preschool). 

The individual staff member has had an 
opportunity to assess his or her 
responsibilities in the program and to 
utilize this information to plan for 
continued growth in knowledge and skills. 
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A. Assessed Needs of Staff (continued) 

The inservice program facilitates 
comnninication and cooperation among 
staff, parents, and community* 

Continuous inservice is provided, 
starting with training prioil to opening 
of school* 

Teachers are involved with other staff 
in plaiming and inplementin^ curriculun 
change. 

The inservice program encourages and 
facilitates exploration of innovative 
programs which may be applicable to 
the local situation. 

The inservice program is subjected to 
continuous eveiluation. 

Adequate funds are budgeted for the 
inservice program. 

Varying staff development approaches 
(large group, small group, individual) 
are being provided. 

The inservice program provides an 
increased knowledge of community 
resources. 

The expertise of school district 

staff is utilized in staff development. 

Alternatives other than college courses 
and workshops are provided. 

Inservice education enhances the building 
of cultural awareness in the community. 

The inservice prograjn provides for 
increased understanding of the forces 
which influence each child's growth and 
development in all areas (physical, 
psychomotor, social, linguistic, affective. 



The inservice program assists team members 
to organize and administer a functional 
educational program, including record 
keeping, planning, preparing, ordering 
materials, and other administrative require- 
ments. 



cognitive). 
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Assessed Needs of Staff (continued) 

Where an appreciable number of atudente 
are firom non-Iiiglieh -speaking fanllieSf 
Inservice oirportunlties are provided 
^icb lead to the developoient of neces-* 
sary bilingual skills in the staff* 

The inservice program encourages 
cooperation among neighboring schools, 
districts, or counties in arranging 
inservice activities. 

Inservice education assists each team 
member to develop a school atmosphere 
in which every child feels wanted and 
uniquely vilued and in which team mem- 
* bers display cfompassion and understanding 

toward every student, toward each other, 
, and toward*^ parents. 

Inservice education develops a functional 
knowledge of various teaching and learning 
styles. 

Released time is provided for classroom 
observation to help teachers clarify 
their understanding of students* 
variations in cognitive, affective, 
and psychomotor development. 

A teacher exchange program is estab- 
lished with nearby districts to provide 
a broadened experiential background. 

If 25 percent or more of the students 
in the school are of diverse ethnic 
backgrounds t the program provides for 
inservice education which will prepare 
the staff to understand and effectively 
relate to the history, culture, and 
current problems of the students and 
their environment. 

Staff Selection and Assignment 

Teaching teaas eidiibit connitaent to the 

philosophy of the program(s) in which 
they are functioning. 

If the school serves students whose home 
language is other than English, staff 
members are recruited from among candi- 
dates who speak the language. 
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REVIEWER'S 



VIII. ARTICDUTION AND COORDINATION OF RESOURCES 

A, Articulation with Preschool lerel and 
Child Care Ppograms 

PreBChool lerel and child care staff members 
are included in planning the inservice 
education program. 

Preschool level and child care staff members 
are included in the planning of the peorent 
education program. 

Preschool level and child care staff members 
are encouraged to participate in the inservice 
education for the kindergarten and elementary 
staff. 

Preschool level and child care staff participate 
in planning the instructional program with 
the K-3 staff to provide a continuum of 
experience for children. 

Costly replication of experience is avoided 
through joint planning for the use of 
community resourcesi field trips^ etc. 

Records of students* progress at the 
preschool level are conmninicated to the 
kindergarten when the student enters school. 

The program provides opportunity for 
intervisitation and coopeirative activities 
by both the staff and the students at 
the preschool and kindergarten-primary 
levels. 

B, Articulation K-12 

Provision is made for the involvement of 
all levels in program planning, implemen* 
tation, evaluation, and modification. 

The program provides for awareness of 
various instructional approaches and 
strategies for the total staff. 

y 

The program provides for replication of 
promising practices of the various in- 
structional levels at other levels as 
appropriate and feasible. 
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Articulation K-12 

There is evidence of teaawox4c among 
the rarioiis organisational levels 
within the school* 

The school provides for instructional 
articulation between K«-6 and the junior 
hi^ and between the junior hi{^ and 
the hi|^ school* 
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STATE PRESCHOOL PROGRAM 
FR-127 

PROGRAM REVIEW - P0I::T^: OF INQUIRY 



INTRODUCTION 

The State Department of Education has produced these state preschool points of inquiry. 
The purpose of this instrument is to assist in the review and examination of state pre- 
school programs at both the school and district levels for compliance with State Regu- 
lations and State Department of Education policy, 

EXPLANATION OF USE 

This instrument is primarily designed to be used by a State Department of Education 
review team. It may be used ty districts for self-analysis, but the results are 
not to be reported to the State Department of Education, 

2, Those points of inquiry which are negatively worded are taken verbatim from regula- 
tions. The use of YES/NO answers requires equating with TRUE/FALSE answers to > 
reply logically to those points of inquiry; i,e,, if a statement is true, mark 
"YES", if the statement is false, mark '*N0" , 

The major levels of inquiry ,(i.,e, , 1.0, 2,0, etc.,)^ are to be answered by first 
aryswering the sau-ievei points of inquiry, which are specific questions. One or 
n6re "riO" answers in the sub-level point of inquiry warrants a "NO'' answer in the 
major level point of inquiry, 

h. /The "Authority Key/Section" column in the Points of Inquiry refers to a specific 
' regulation or policy found in the following official documentsv 

Authority Kejr ^ 

1. Regulations for Consolidated Categorical Aid Programs ('Title 5 and Federal)' 

2,, Instructions for Completing the Comprehensive School Program Plan ([A-12TS), 

3. Instructions for Comprehensive Prograr. Planning" 

h. Addendur^ to Instructions for Comprehensive Program Planning {NPS, N&D , 
Co-op), 

5. Management Information and Requirements for Programs Funded through A-12T 

^ 6, Consolidated Application (A-127) 

T- Manual of Instructions for Completing Consolidated Evaluation Report 

8. Title II State Plans 

9. Policies for Early Childhood Education 
10. AB 228U 

11,. Guidelines for the ?tate Preschool Program 

12, California A'^m i ni strat i ve Code, Title 22 

13. AB h5l 

1^4 California Education Code 

15. California Administrative Code, Title 5 

16. California Administrative Code, Title 19, Article 8 



IS - State Regulation 
IF - Federal Reirulation 



TABLE OF CONTENTS 
PR 121 STATE PRESCHOOL PROGRAM 
POINTS OF INQUIRY 



TOPIC PAGE 

1.0 State Preschool Program PI 

1.1 Selection of School Sites ^ PI 

1.2 Selection of Participants PI 

1.3 Needs Assessment P2 

1.^ Program Components and Objectives >>....... P2 

' 2.0 Individualized Instruction P2 

3.0 Maximum Levels of Service P2 ^ 

U.O Parent and Community Involvement P3 

5.0 Evaluation ....v P4 

6.0 Fiscal and Administration P^ 

7.0 Attendance v .......... * P 5 

8.0 Administrative Procedures . . . v P5 

9.0 Facilities ^ P7 

10.0 Fiealth and Auxiliary Services P8 

ri.O Management Plan a..-.. P9 
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POINTS OF INQUIRY 



SCHOOL LEVEL - STATE PRESCHOOI 



t 127 (FY 1974-75) 
iv. 8/14/74 

!• 
2, 
3. 

5. 



AREA 1.0 rOPIC State Preschool Program 



SOURCES or INFORMATION 



Prograra Director 

Business Manager 

Teacher 

Aide 

Parent 



6. Principal 

?• Resource Person 

8» School Plan 

9, Planning Products 

10, Evaluator 



11, Head Teacher 



AUTHORITY 
CEY/SECTION 



11 :IIc 



11 : Appendix 

A & 5 
11:111 B 



11:111 Bl 



11:111 B2 



U : 1 1 1 A 



11:111 A 



11 : Append i x 



11:111 B 
|ll : Append i x 
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1.0 STATE PRESCHOOL PROGRAM 

1 .1 Selection of School Sites ' 

Sites we re selected in areas where 
they are aost likely to achieve 
racial balance, minimize segrega- 
tion, and facilitate ■ integration . 

1 . 2 Selection of Participants. 

Program participants are selected 
according to the following: 

1.2-1 Participants are selected on 

the basis of families which 
were former, current, or poten- 
tial A.F.. D.C. recipients and 
other low income and disadvan- 
taged far.ilies . 

{a) Family income determina- 
tions are based on actual 
income data, -such as W2 * 
forms or ''-alary stubs 

1 .2-2 Priority is given to children 

from families in which ins^lish 
is not the primary language. 

1.2-3 ' There is evidence that prior 

approval has been obtained from 
the SDE for children between 
ages three and three years nine 
rr.ont hs . 

1.2-U « Children are between the ages 
„ of three and four years nine 

months (on September l) at the 
time of enrollment,., 

1.2-5 There is written Justification for 

the enrolln#*nt of chilHrej^ over 
the age of four years nine months 
as of September I.: 

1.2-6 Each child's eligibility is evi- 

denced in a written certification 
by project director. 
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SCHOOL LEVEL • STATE PRESCHOOI 



PR 127 (FY 1974-75) 
Rev. 8/14/74 

!• 
2. 
3. 
4, 
5. 



2.0 Individualized Inst; 

AREA 3.0 TOPIC Maximum Levels cf 3 



SOURCES OF INFOllMATIOH 



Program Director 

Business Manage r 

Teacher 

Aide 

Parent 



6. 
7. 
8. 
9, 
10. 



Principal 11. Head 

Resource Person 
School Plan 
Planning Produces 
Evaluator 



AUTHORITY 


POINTS OF 


INQUIRY 


w 

u o 


ui o 


u o 


(A 

w o 


KEY/SECTION 


SCHOOL 


LEVEL 


>* z 


> ss 


, >- SB 





l:i:2 
3:2.2 



1.:: 

11:IV B 



12:31301-05 
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1 . 3 Keeds Asses sment 

comprehensive needs assessment 
includes the preschool participants 
(Refer to district and school j.evel 
points of inquiry pages D5 , d6 , and 
S2, S3. ) 

1 . ^4 Program Components and (bjectives 

The program includes each of the 
f ollowi np, : 

l.U-1 Language Development 

1.U-? Staff Development 

1.^-3 Parent Participation and Comiru- 

r.ity Involvement 

l.^-i* Parent Education 

l.U-5 Health/ Aux i liary Services* 

l.U-6 Multicultural Education 

l.^-T Education Development 

l.Ur-8 Bi 1 i ngual/C ros s c ul t ural Education** 

2 . 0 INDIVIDUALIZED INSTRUCTION 

Each child hjis ar. appropriately individ- 
ual i zed program . 

?.0-l A written record is available cf each 
child's develop me ntal progress" 

3.0 MAXIMUM LtVELS ()F SERVlCh 

Costs for program (not inc3udir.g rent 
or transportation? do not exceed pub- 
lished per capita maximums unless 
waiver has been approved. ($1,150 
for 3^. or u-hour sessions; $9uO for 
3 hours; $650 for 2^-hour sessions} 

*Health and Auailiary services include nutrition, 
t ra.isport at io n , and social services for State 
Preschool purposes. 

**The bi li ngual /crossc u2 tu r al component is required 
if the school needs assessment shows an appreciable 
number of students for whom English is not the 
primary home language. 



3€9 



P 2 
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SCHOOL LEVEL - STATE PRESCHOOI 



I 127 (FY 1974-75) 
IV. 8/14/74 

\ 

1. 

2. 
3. 
U. 
5. 



'^AREA A.O 



SOURCES or INFORMATION 
Program Director 6* 
Business Manager 7. 

Teacher 8. 

Aide 9. 



TOPIC Parent and Co w^ untty 
Involvement 



Parent 



10. 



Principal 
Resource Person 
School Plan 
Planning Products 
Evaluator 



11. Head Teacher 
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AUTHORITY 
m/S£CTION 



SOURCE 



11:V G 

11:V B 

11:V B 
11:V B 

11: V 

11:V G 



3:1.1. 1 
2.1. 1 



3:1.1.2 
2.1.2 



3:1.1 

^ : Addendum 



3:1.1 



U.0-1 



i*.0-2 



U.0-3 



l*.0-5 



1.0-8 



l*.0-9 



PARENT AND COMMUNITY INVOLVEMENT 

The program provides for the required 
parent and community involvement as 
evidenced by the following criteria: 

The program includes home visits 
by members of the instructional 
staff. ' 

The School Advisory Committee in- 
cludes representation from Preschool. 

A separate Advisory Committee for 
Preschool is chaired by a parent. 

( a ) Fi f ty-one percent of such 
a comm i tt ee consists of 
parents of currently 
enrolled children. 



There is a unified parent involve- 
ment program even thoi'gh funds for partici- 
pating children may be from different 
sources . 

A minimum of -sight parent education 
r.eetin/^s per year are held. 

Advisory committee at least ircludes 
representatives of staff and *ion- 
school organ izat ions. 

There is evidence that the ^Advisory 
Commit tee has participated in the 
development of the comprehensive 
plan and needs assess me nt, estab- 
lishment of goalc and objectives, 
and evaluation of the program. 

Each district has the required DAC 
products available. (Refer to 
Page D13. ) 

Each school has the required SAC 
producL? available. (Refer to 
Page SIO. ) 
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1* 
2. 
3. 
4. 

' 5 . 



AREA_ 

SOURCES or INFORM^ION 

Prograni Director 6. 

Business Manager 7, 

Teacher 8, 

Aide » • 9. 

Parent 10. 



5.J1 
"6 O" 



TOPIC Evaluation 



Piincipal 
Re:;ource Person 
School Plan 
Planning Products 
Evaluator -J 



Fiscal and 
11. 



Head 



authority' 
key'/section 



3:1.3.3 
3-2,3.3 
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5.0 ,tVALUATlUN 

The agency has on file an evalua- 
tion design which includes the 
following: 

5,. 0-1 The agency evaluates its own 

State Preschool program 
activities . 

5.0-2 ^he agency incorporates the 

preliminary results of this 
evaluation into the preparation 
of the following year's plan. 

5. ^0-3 There are evaluation criter'^a' 

for e^ch prograr. object ive., 

6,0 FISCAL AND ADMINISTRATION • 

The applic ant agency has con plied 
with the fiscal administrative 
requirements as follows-; 

6.0-1 The applicant agency ha^ devel- 

oped auditable records which 
identify expenditures by fund- 
in k a oi* r c e 

6.0-2 If Capital Outlay exne nd i t ure s 

are budgeted, they are only 
used for instructional equip-- 
r.ent used by children, 

6.0-3 Capital Outlay purchases have 

received writteM prior approval 
fr . the SDK,. 

6. ^0-U Funds are not budgeted for pur- 

chase or lease -pure ha se o-f facil- 
ities or for rental of a facility 
owned by >tfte applicant agency. 

6.0-5 ' Equipment is inventoried and is 
labeled es to source of fundi n-g 
and year of purchase, 

»6.0-6 Rent is charged for only one 

classrooir. when more than one 
class meets in the same room.- 

6 . 0-T At least, two bids have been 

secured from transportation corn- 
pa nioii^ when transportation is 
needed.. 
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1. 

2. 
3. 
4. 
5, 



AR1:A 7,0 TOPIC At:tenH;,nt 



8.0 



SOURCES or INFORHATIOJ 
Program Director 6. Principal 

Bus iness Manager 7. Resource Person 

Teacher &. School Plan 

Aide 9. Planning Products 

Parent 10, Evaluc^tor 



Administrative Procedures 
11 • Head Teacher 



authority 
:y/sec 
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LIjVIII a 2 



Llr-VIII F3 
L1*:.16T26 

Ll:'VriI C 

ii:viii :i 

Ll:'VIIi C 



II 1 



L1:-III 53 



.2: 31221 



.1:*IV 6 



^ ? V 1 e r» c e ; (i . . , a letter) exists 
that iistrict auditors have 
1: e e r» i v e "Instructions to 
Auditors ' N ^ '.^ Audit State ? r e - 
sch,cci Fducat ional Programs" . 

ATTENDANCE 

Atter.dar.ee records are coriplete ari 
accurate for each class:- 

A vaitir.^:: list is r.airtaine-f . 



" . 0- 



5. 



3 . 0-5 



^li>;:biliti 
dete* r.irie'i 
adr.: s 3 1 ^r. s . 



of children i i 
:t the tin:e cf 



r X c u s e d a 1 3 Ti c e s and attendance 
are reportei cly for enr:''le^ 
eligible children.' 

--Excuse i absences are deternine'i 
to be only for illness or quar- 
antine. 

'.iO no re? than five days of unex- 
^cused absence per year per child 
0 have been clair.e^ for rejr.hL.r3e- 

ADMINISTRATIVC PROCEDURES 

A d i n i 0 1 r a t i V e procedures are observed 
and n r 1 e r. e :i t e 'I a o f o 1 1 o w s 



1 policies and Job\descrip- 
e av5>ilable in vri^in^> 



F e r i;> o n n i 
t i c r. G are 



Tne confidentiality cf social serv- 
ice r e 0 2' 'i s and information is 
rr.iir^tained. 

A i m i s s i o n c r i t r i a are i n v r i t i n r 
and available to the public. 



/r.. 



A full-time Program Supervisor Is 
'^ha -ed to the project only if 
on more chiliren are enrolled. 

There io on in-service education 
p r 0 r r ar for staff n d volunteers. 



SOURCE 
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SOURCES or INFORMATION 



1. Program Director 

2 . Bus ine ss Manager 

3. Teacher 

4. Aide 

5. Parent 



AREA 8.0 TOPIC Administrative Pro 

11. Head T 



6. Principal 

7 . Resource Person 

8. School Plan 

9. Plan'iing Products 
10. E valuator 



AUTHORITY 
KEY/SECTION 



POINTS OF INQUIRY 
SCHOOL LEVEL 
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7i 



CO 
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11 : IV E 



11 IV A3 



11 : VII G 



11 :JI J 



II :i: J 1 



11 JiV D 



LI : IV ^ 



Li : IV Al 



i 1 : V i i * nl 



12 : 312-^ 



1 1 V I IT : i 



11-:IV A2 



ll.:-IV F 



ERLC 



8.0-6 



. 0-7 



.0-8 



LC-9 



8. 0-iO 



8.0-1 



3. 0-12 



.0-1' 



8.0-^:7 



6. 0-19 



8.0-20 



There is at least one mer.be r 
cf the instructional staff 
who is proficient in th^ hor.e 
language's) of the children. 

There is diver s'ity cf racial 
ar^d ethnic representation in 
the staff corresponding to 
the popalatxcri served . 

Staff nembers eat v.icn the 
children . 

Instructional sessions are 
not less than 2^:> hours or 
r.ore than four hours. 

Instructional serviced ether 
than Zh hours h.ave heen Justi- 
fied in V r i t i ^ ^" t u the 3 2 E . 

M a X i r. u r:' n r > • c x* c f children 
per class is 2? . 

An d d u 1 1 - r u p. i : ratio c f at 
^ e a i t, 1 V 5 1 ^ .T* 'i i r: t a 1 n e 1 . 

V 0 1 ^ 1. 0 e r V i L i serve w I. \ 
efxrn /'xass of If ch\l'irpn. 

^ecor'is of "/c^I'inteer assistan*"*- 

are Tt a i n t a i n e s h w i n e the 

t i ^: »: contributed by each parent. 



• a y 1 r ^rr. nur. c er o i c { 
t e a" ner is If. 



3 r e n per 



r o-i ai s e rv i ce <5 ^r*^ s upe ."v i s e ^' 

by a qualified professional. 

The dates of each child's adr.is- 
2 ion and d 1 g c .oa i-^^^tr e shown m 
hir foloer. 

There is a procedure f ' r forwari- 
inf: children's recori^ to the 
e 1 ement ary c ho ,^ I . 

All t e a c >i e r s a n ^ c u p e r •/ 1 r> o r 
hold current appropriate c r e - 
i o n 1 1 a 1 o or permits. 

Training and Job o p p o r t u n 1 1 i e n 
a r r a d ^ a v a i 1 r b 1 e tr^ public 
a«:sistance recipients. 



p (> 



POINTS OF IMOUIRY 



SCHOOL LEVEL - STATE PRESCHOOl 



PR 127 (FY 19/4-75) 
lev. 8/14/74 



AUTHORITY 
KEY/SECTION 



AREA TOPIC FnciUti* 

SOURCES or INFORMATION 



1. 


Program Director 


6, 


Principal 


11. Head Teacher" 


2. 


Business Manager 


7, 


Resour ce Person 




3. 


Teacher 


8. 


School Plan 




4. 


Aide 


9, 


Planning Products 




5. 


Parent 


10, 


Evalua tor 
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SOURCE 



11:- 1 1 ir 



12:. 3 13^4^ 



12-313:1 

15 '120^!: 
1 2 . 3 i 1 



15-12G?6c 



12:. 31 31 K 

i 2 ' 1 Ti : 



12 



0 , 0 



9. C-2 



FACILITIhS 

State prtschcol facilities cc^-ply 
with the fcl'. ovir.^ r equ i rercon t s -:• 

/it least 35 square feet cf 
v*nen c un:l ore d fleer space is 
p r 0 V i 'i e Ji ^ a c h c ^. i 1 d in e a c r, 
classrccr. T 

At 1 e a c t "5 square fee*: are 
p r : V i i e o e a c c h 1 1 u i r. t h e 
c'ltio^r play area. 

/II r 0 r. s are e c (i. r. i >: e. 2 y 
" e n t. i 1 a t e ^ . 

\ separate c""f cr flocr ra^ is 
prcviAei eac-. c 'm 1 Jror whom raps 
ar<^ "^^c^.'.'ied m t '".c prc^ra^*. . 

T r. e r e is a separate s t c r a e 
space f r e a c r c? i 1 ' s c 1 c t h : » 



/ippliOii are accessiole t- 

a : ^ 1 1 V J. t r. ^ t 1 e a V 1 r. r c ni 1 i r ^ r 

u r. a 1 1 e i e d . 

1 3 i 1 e t s , s 1 r. k i: , 1 r. : c . ^ r. t e r t ~ r c 
are at a proper :ei^*r.t f^.r 
c h i ] Iren . 



. ^ ^ r e IS <■ n e 
f r ^ a J? h 



c h i 1 d r e n . 



, r. e r e i s at i e a j 
t^i^et ar.J 1 



one separate 
[r. for 1 G c i a t I , n 



ani erer^:enry ure. 

There i 5^ ar. lsclati:.r. area f r 
childrer f'-r emergency illr, esr 



*fiere is a separate staf r-^'r 
with a c ru^* ri . 

W hen i M r; c h is s e r v e 1 , the k 1 1 ."he: 
includes a 3 1 n v e , i n k , h. - 1 a r; 1 
o 1 d r u n n i ri g water, r e f r i i-' e r a * i ■ r 
ar. i e qua t e ^ t o r a^-:*' -.^ft<'(^. 

When dishes Q.Tf vasr.ci or.-' it^, 
d i s h. V a h i n p r - . c e i \^ i e r, ; r v 1 ; o 
for cterilizat i . 
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AREA 1 n . 0 TOPIC Up^^lth anH Auxillar; 
S erv ic es 

SOURCES or INFORMATION 

1. Program Director 6. Principal 11. Head Tea( 

2. Business Manager 7, Resource p'firson 

3. Teacner 8. School Plan 



4. Aide 

5. Parent 



9, Planning Products 
10, Evaluator 



AUTHORITY 
KEY/SECTION 



POINTS OF INQUIRY 
SCHOOL LEVEL 
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SOURCE 



12 : 3:::' 



: .' a. J .. a * ; :. 1 r. s are r 3 ^ ' e i . 

'. r 1 r. k ; :;. r * - - ^ a a i 1 ?. I i e 

1 r. : : . :■ r a r. i : • : t an c h 1. 1 ^: r e r. ' s 

T e . ^ 1 : . r :-. r o a r y : L les I . t 
3 ^r. £ i r. e > s :.a ie . 

7 r. e r •: 1 c a : . a ^ , . t : r 
: r a i r. a ^• e . 

7 e : ^ t i : ^ r a r 1 : ^ f e r c : . 



• : p . ay *r .r: i 



^ >• a " J c s - 



c a \ 1. «L' 



Hi/'.in^ A\:) AIXIIIAKY SERVrCr-S 



' • / " a r 
. a : * * ■ 



J.. 
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AREA IKO TOPIC M;»n3PPmpr.r 



SOURCES 
Program Director 
Business Manager 
Teacher 
Aide 
Parent 



Of 



INFORMATION 
6 . 
7. 
8, 
9- 
10, 



Principal 
Resource Pe r son 
School Plan 
Planning Products 
Evaluator 



11, Head Teacher 



AUTHORITY 
KEY/SECTION 


POINTS OF INQUIRY 
SCHOOL LEVEL 


Ui o 
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Ui o 
>- 55 


u o 
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Ui o 
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SOURCE 


12:31323 


10,0-7 Thereisastockedfirstaid { 





12:31323 



11:VII Bl 
15:12036 "F 
12:31243 

11:VII B2 



12:31219 



11: VII F 



,3:1.2.1 



cabinet on site., 

10.0-8 The first aid cabinet is inacces- 

sible to children. 

10.0-9 A pnysician is available for 

consultation and health program 
supervision . 

10.0-10 A licensed public health nurse 
or a school nurse supervises 
health development. 

10.0- II There is a record of a physical 

examination for each staff member, 

10.0-12 All paid and volunteer staff 

members who have contact with the 
children have current T. B.. clear- 
ance s . 

11.0 MANAGEMEMT PLAN" 

The school is implementing its 
nanagement plan. (Refer to the 
school level man n Recent plan points 
0*" f nau! rv, "acto 
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